-- Logs begin at Sat 2022-09-03 03:10:30 UTC, end at Sat 2022-09-03 04:09:50 UTC. -- Sep 03 03:40:44.833126 dv-cinder-799663-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 03 03:40:44.840887 dv-cinder-799663-12-iscsi devstack@n-api.service[117083]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 03 03:40:44.844114 dv-cinder-799663-12-iscsi devstack@n-api.service[117083]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 3 03:40:44 2022] *** Sep 03 03:40:44.844114 dv-cinder-799663-12-iscsi devstack@n-api.service[117083]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 03 03:40:44.844114 dv-cinder-799663-12-iscsi devstack@n-api.service[117083]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 03 03:40:44.844114 dv-cinder-799663-12-iscsi devstack@n-api.service[117083]: nodename: dv-cinder-799663-12-iscsi Sep 03 03:40:44.844114 dv-cinder-799663-12-iscsi devstack@n-api.service[117083]: machine: x86_64 Sep 03 03:40:44.844114 dv-cinder-799663-12-iscsi devstack@n-api.service[117083]: clock source: unix Sep 03 03:40:44.844114 dv-cinder-799663-12-iscsi devstack@n-api.service[117083]: pcre jit disabled Sep 03 03:40:44.844114 dv-cinder-799663-12-iscsi devstack@n-api.service[117083]: detected number of CPU cores: 4 Sep 03 03:40:44.844114 dv-cinder-799663-12-iscsi devstack@n-api.service[117083]: current working directory: / Sep 03 03:40:44.844114 dv-cinder-799663-12-iscsi devstack@n-api.service[117083]: detected binary path: /usr/bin/uwsgi-core Sep 03 03:40:44.844114 dv-cinder-799663-12-iscsi devstack@n-api.service[117083]: your processes number limit is 47680 Sep 03 03:40:44.844114 dv-cinder-799663-12-iscsi devstack@n-api.service[117083]: your memory page size is 4096 bytes Sep 03 03:40:44.844114 dv-cinder-799663-12-iscsi devstack@n-api.service[117083]: detected max file descriptor number: 2048 Sep 03 03:40:44.844114 dv-cinder-799663-12-iscsi devstack@n-api.service[117083]: lock engine: pthread robust mutexes Sep 03 03:40:44.844901 dv-cinder-799663-12-iscsi devstack@n-api.service[117083]: thunder lock: enabled Sep 03 03:40:44.844901 dv-cinder-799663-12-iscsi devstack@n-api.service[117083]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 03 03:40:44.844901 dv-cinder-799663-12-iscsi devstack@n-api.service[117083]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 03 03:40:44.883763 dv-cinder-799663-12-iscsi devstack@n-api.service[117083]: Python main interpreter initialized at 0x5573416a49c0 Sep 03 03:40:44.883763 dv-cinder-799663-12-iscsi devstack@n-api.service[117083]: python threads support enabled Sep 03 03:40:44.883763 dv-cinder-799663-12-iscsi devstack@n-api.service[117083]: your server socket listen backlog is limited to 100 connections Sep 03 03:40:44.883763 dv-cinder-799663-12-iscsi devstack@n-api.service[117083]: your mercy for graceful operations on workers is 90 seconds Sep 03 03:40:44.884155 dv-cinder-799663-12-iscsi devstack@n-api.service[117083]: mapped 403077 bytes (393 KB) for 2 cores Sep 03 03:40:44.884155 dv-cinder-799663-12-iscsi devstack@n-api.service[117083]: *** Operational MODE: preforking *** Sep 03 03:40:44.884430 dv-cinder-799663-12-iscsi devstack@n-api.service[117083]: *** uWSGI is running in multiple interpreter mode *** Sep 03 03:40:44.884430 dv-cinder-799663-12-iscsi devstack@n-api.service[117083]: spawned uWSGI master process (pid: 117083) Sep 03 03:40:44.884641 dv-cinder-799663-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 03 03:40:44.885145 dv-cinder-799663-12-iscsi devstack@n-api.service[117083]: spawned uWSGI worker 1 (pid: 117084, cores: 1) Sep 03 03:40:44.888513 dv-cinder-799663-12-iscsi devstack@n-api.service[117083]: spawned uWSGI worker 2 (pid: 117085, cores: 1) Sep 03 03:40:44.888513 dv-cinder-799663-12-iscsi devstack@n-api.service[117083]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 03 03:40:45.534493 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 03 03:40:45.535417 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 03 03:40:46.602950 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 03:40:46.602950 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: from cryptography.utils import int_from_bytes Sep 03 03:40:46.603657 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 03:40:46.603657 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: from cryptography.utils import int_from_bytes Sep 03 03:40:46.605774 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 03:40:46.605774 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: from cryptography.utils import int_from_bytes Sep 03 03:40:46.606225 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 03:40:46.606225 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: from cryptography.utils import int_from_bytes Sep 03 03:40:49.117826 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 03 03:40:49.118460 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 03 03:40:49.118585 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 03 03:40:49.118773 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 03 03:40:49.119176 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 03 03:40:49.119276 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 03 03:40:49.119345 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 03 03:40:49.119602 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.119725 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 03 03:40:49.119869 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.119971 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 03 03:40:49.120181 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 03 03:40:49.120325 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.120501 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.120597 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.120859 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.120993 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.121163 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.121319 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.121454 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.121554 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.121786 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.121917 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.122101 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.122233 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.122334 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.122416 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.122655 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.122788 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.123010 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799663-12-iscsi {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.123142 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.123253 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.123337 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.123598 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.123747 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.123911 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.124091 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799663-12-iscsi {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.124236 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.124364 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.124496 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.124631 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.124780 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.124917 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.125118 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.125309 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.125445 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.125662 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.125807 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.125989 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.126105 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.126317 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.126473 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.126603 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.126792 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.126962 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.127108 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.127278 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.127424 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.127588 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.127734 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.127910 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.128054 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.128219 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.128331 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.128543 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.128653 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.128853 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.128956 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.129210 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.129310 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799663-12-iscsi {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.129517 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.129621 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.129851 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.129946 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799663-12-iscsi {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.130165 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.130251 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.130512 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.130605 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.130843 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.130957 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.131198 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.131319 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.131572 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.131668 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.131893 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.131990 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.132202 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.132288 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.132519 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.132617 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.132829 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.132931 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.133151 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.133242 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.133468 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.133560 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.133772 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.133870 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.134084 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.134259 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.134403 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.134545 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.134683 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.134854 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.135000 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.135147 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.135288 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.135433 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.135584 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.135721 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.135857 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.136013 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.136159 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.136294 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.136443 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.136580 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.136723 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.136871 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.137020 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.137178 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.137323 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.137462 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.137611 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.137757 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.137757 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.138056 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.138272 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.138416 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.138552 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.138689 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.138865 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.139010 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.139147 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.139298 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.139437 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.139584 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.139732 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.139869 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.140005 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.140143 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.140280 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.140419 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.140563 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.140700 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.140836 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.140979 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.141141 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.141280 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.141430 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.141575 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.141711 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.141854 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.141989 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.142133 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.142270 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.142407 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.142587 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.142737 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.142934 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.143099 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.143238 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.143383 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.143528 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.143665 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.143800 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.144020 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.144235 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.144404 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.144549 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.144687 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.144825 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.144972 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.145123 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.145259 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.145397 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.145536 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.145681 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.145819 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.145956 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.146099 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.146236 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.146379 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.146528 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.146672 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.146852 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.146998 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.147134 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.147271 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.147425 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.147574 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.147718 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.147855 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.147993 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.148129 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.148294 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.148517 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.148662 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.148809 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.148953 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.149104 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.149242 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.149378 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.149519 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.149661 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.149806 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.149992 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.150134 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.150278 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.150415 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.150551 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.150707 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.150953 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.151098 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.151235 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.151370 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.151506 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.151642 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.151642 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.151921 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.152056 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.152192 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.152327 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.152461 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.152622 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.152767 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.152912 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.153062 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.153198 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.153342 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.153487 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.153624 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.153760 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.153920 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.154058 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.154193 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.154337 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.154493 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.154629 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.154766 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.154927 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.155075 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.155225 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.155362 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.155505 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.155642 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.155778 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.155913 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.156058 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.156195 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.156379 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.156530 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.156666 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.156812 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.156949 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.157091 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.157237 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.157374 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.157582 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.157805 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.157959 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.158101 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.158252 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.158390 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.158546 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.158788 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.159009 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.159152 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.159290 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.159426 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.159563 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.159719 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.159858 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.160006 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.160006 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.160281 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.160433 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.160579 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.160724 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.160871 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.161008 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.161144 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.161289 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.161427 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.161583 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.161728 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.161873 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:40:49.162010 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.162167 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.162313 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.162451 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.162670 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.162837 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.162994 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.163142 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.163289 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.163428 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.163575 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.163712 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.163857 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.164012 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.164158 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.164296 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.164434 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.164570 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.164716 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.164861 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.164998 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.165144 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.165291 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.165429 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.165574 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.165710 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.165857 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.166023 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.166171 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.166309 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.166456 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.166594 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.166731 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.166941 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.167084 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.167222 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.167368 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.167508 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.167657 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.167803 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.167941 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.168095 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.168234 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.168372 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.168510 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.168726 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.169022 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.169194 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.169342 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.169482 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.169624 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.169799 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.169941 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.170089 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.170228 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.170371 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.170509 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.170648 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.170785 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.171043 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.171185 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.171331 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.171476 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.171621 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.171789 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.171937 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.172073 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.172210 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.172346 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.172482 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.172629 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.172768 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.172905 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.173042 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.173179 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.173316 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.173462 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.173609 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.173755 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.173893 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.174114 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.174328 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.174492 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.174639 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.174778 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.174967 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.175107 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.175246 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.175397 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.175550 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.175688 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.175825 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.175975 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.176127 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.176266 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.176403 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.176540 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.176678 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.176846 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.177010 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.177157 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.177295 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.177444 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.177581 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.177748 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.177909 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.178143 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.178300 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.178449 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.178588 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.178725 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.178909 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.179151 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.179297 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.179434 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.179594 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.179742 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.179891 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.180029 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.180168 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.180305 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.180443 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.180589 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.180727 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.180863 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.181008 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.181149 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.181287 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.181455 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.181594 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.181730 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.181877 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.182016 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.182162 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.182310 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.182448 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.182585 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.182722 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.182884 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.183039 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.183177 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.183334 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.183472 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.183609 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.183746 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.183892 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.184031 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.184168 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.184306 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.184443 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.184579 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.184729 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.184875 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.185023 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.185160 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.185298 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.185444 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.185687 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.185834 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.185972 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.186109 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.186257 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.186406 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.186559 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.186697 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.186895 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.187051 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.187189 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.187341 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.187483 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.187627 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.187766 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.187903 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.188040 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.188187 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.188333 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.188499 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.188667 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.188807 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.188963 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.189133 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.189348 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.189500 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.189641 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.189786 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.189935 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.190074 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.190210 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.190355 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.190493 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.190632 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.190787 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.190961 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.191100 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.191237 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.191373 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.191509 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.191659 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.191796 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.191935 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.192070 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.192207 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.192352 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.192498 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.192647 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.192804 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.192942 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.193079 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.193230 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.193369 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.193505 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.193644 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.193818 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.193977 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.194125 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.194273 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.194412 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.194591 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.194747 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.194916 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.195067 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.195243 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.195388 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.195559 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.195703 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.195874 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.196029 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.196168 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.196305 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.196479 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.196633 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.196783 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.196924 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.197090 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.197235 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.197402 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.197586 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.197738 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.197876 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.198015 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.198158 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.198295 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.198436 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.198663 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.198876 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.199022 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.199160 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.199307 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.199468 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.199615 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.199753 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.199899 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.200036 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.200173 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.200316 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.200499 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.200653 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.200806 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.200953 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.201099 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.201246 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.201384 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.201521 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.201670 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.201808 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.201944 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.202095 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.202234 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.202385 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.202522 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.202667 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.202861 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.203018 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.203159 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.203295 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.203431 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.203567 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.203703 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.203851 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.203996 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.204133 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.204281 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.204418 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.204594 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.204752 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.204898 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.205036 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.205175 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.205314 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.205501 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.205655 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.205830 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.205975 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.206120 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.206278 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.206427 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.206565 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.206731 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.206920 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.207068 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.207214 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.207362 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.207500 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.207672 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.207813 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.207956 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.208094 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.208249 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.208389 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.208527 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.208664 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.208800 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.208947 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.209109 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.209253 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.209494 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.209651 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.209798 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.209951 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.210109 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.210247 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.210384 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.210522 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.210659 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.210928 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.211087 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.211226 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.211366 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.211506 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.211642 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.211789 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.211927 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.212081 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.212219 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.212356 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.212502 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.212641 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.212782 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.212918 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.213054 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.213201 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.213347 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.213485 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.213648 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.213793 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.213955 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.214094 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.214239 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.214377 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.214514 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.214652 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.214883 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.215033 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.215183 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.215322 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.215458 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.215602 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.215773 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.215936 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.216084 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.216221 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.216366 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.216503 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.216673 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.216827 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.216967 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.217103 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.217269 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.217421 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.217587 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.217739 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.217889 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.218027 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.218176 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.218314 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.218482 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.218684 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.218861 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.219030 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.219178 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.219316 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.219473 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.219658 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.219808 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.219958 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.220116 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.220281 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.220432 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.220577 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.220721 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.220871 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.221017 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.221161 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.221314 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.221458 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.221609 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.221763 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.221907 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.222055 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.222319 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.222477 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.222622 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.222765 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.222945 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.223103 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.223289 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.223452 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.223607 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.223751 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.223923 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.224078 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.224223 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.224373 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.224531 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.224676 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.224818 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.225294 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.225454 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.225680 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.225838 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.225984 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.226143 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.226296 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.226440 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.226592 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.226737 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.226938 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.227086 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.227242 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.227388 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.227541 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.227686 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.227829 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.227972 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.228127 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.228273 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.228426 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.228585 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.228730 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.228872 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.229015 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.229158 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.229311 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.229458 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.229608 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.229799 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.229903 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.230002 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.230085 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.230164 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.230242 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.230401 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.230566 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.230723 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.230907 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.231058 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.231205 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.231366 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.231512 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.231671 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.231829 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.231973 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.232116 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.232261 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.232412 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.232571 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.232729 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.232874 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.233018 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.233162 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.233319 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.233465 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.233620 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.233764 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.233908 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.234051 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.234208 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.234354 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.234496 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.234641 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.234784 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.234986 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.235143 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.235296 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.235442 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.235596 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.235740 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.235883 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.236035 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.236180 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.236330 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.236483 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.236629 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.236781 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.236926 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.237069 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.237211 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.237353 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.237507 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.237661 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.237807 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.237952 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.238095 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.238237 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.238389 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.238543 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.238688 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.238850 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.239000 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.239157 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.239303 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.239465 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.239611 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.239763 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.239931 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.240081 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.240239 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.240386 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.240539 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.240740 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.240896 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.241042 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.241195 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.241362 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.241507 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.241651 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.241801 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.241946 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.242098 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.242244 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.242399 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.242552 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.242704 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.242866 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.243029 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.243175 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.243330 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.243473 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.243616 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.243767 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.243912 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.244056 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.244205 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.244349 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.244492 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.244644 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.244788 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.244940 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.245093 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.245247 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.245391 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.245543 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.245688 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.245831 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.245985 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.246131 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.246274 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.246425 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.246570 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.246720 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.246897 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.247046 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.247213 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.247362 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.247505 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.247647 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.247790 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.247933 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.248085 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.248231 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.248374 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.248517 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.248660 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.248803 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.248960 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.249116 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.249261 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.249404 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.249556 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.249700 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.249892 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.250074 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.250222 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.250365 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.250517 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.250673 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.250838 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.251003 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.251147 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.251291 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.251435 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.251596 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.251742 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.251893 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.252043 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.252188 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.252332 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.252485 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.252629 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.252772 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.252925 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.253075 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.253219 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.253371 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.253516 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.253667 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.253810 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.253953 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.254104 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.254248 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.254400 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.254544 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.254544 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.254863 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.254863 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.255156 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.255308 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.255463 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.256176 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.256370 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.256517 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.256662 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.256814 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.256959 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.257103 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.257338 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.257338 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.257623 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.257775 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.257919 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.258061 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.258212 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.258357 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.258499 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.258641 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.258797 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.258979 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.259132 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.259289 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.259431 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.259582 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.259728 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.259879 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.260026 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.260167 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.260310 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.260459 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.260605 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.260761 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.260915 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.261059 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.261212 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.261355 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.261498 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.261648 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.261806 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.261952 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.262095 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.262238 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.262390 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.262534 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.262677 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.262879 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.263041 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.263185 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.263344 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.263491 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.263636 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.263780 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.263931 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.264075 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.264295 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.264457 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.264602 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.264746 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.264889 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.265044 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.265196 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.265341 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.265483 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.265627 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.265770 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.265926 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.266072 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.266215 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.266358 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.266502 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.266652 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.266821 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.266984 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.267129 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.267283 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.267436 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.267580 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.267741 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.267887 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.268030 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.268173 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.268324 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.268468 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.268620 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.268765 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.268918 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.269061 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.269213 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.269366 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.269509 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.269652 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.269795 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.269938 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.270080 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.270233 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.270385 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.270538 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.270693 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.270890 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.271051 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.271206 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.271354 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.271497 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.271640 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.271791 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.271991 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.272149 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.272294 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.272439 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.272592 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.272592 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.272899 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.273074 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.273227 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.273387 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.273534 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.273684 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.273829 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.273979 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.274197 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.274343 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.274496 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.274640 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.274794 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.274961 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.275122 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.275268 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.275412 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.275556 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.275699 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.275843 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.275995 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.276139 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.276285 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.276435 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.276590 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.276743 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.276900 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.277062 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.277208 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.277352 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.277496 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.277648 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.277792 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.277935 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.278079 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.278289 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.278448 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.278625 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.278779 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.278962 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.279120 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.279265 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.279409 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.279563 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.279708 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.279859 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.280003 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.280146 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.280290 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.280448 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.280609 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.280754 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.280897 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.281054 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.281207 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.281351 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.281494 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.281646 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.281792 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.281936 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.282093 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.282238 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.282390 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.282552 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.282697 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.282942 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.283081 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.283169 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.283250 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.283328 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.283416 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.283497 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.283585 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.283667 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.283745 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.283830 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.283910 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.283997 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.284085 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.284174 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.284254 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.284333 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.284410 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.284512 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.284756 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.284900 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.285069 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.285212 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.285348 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.285458 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.285653 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.285817 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.285965 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.286109 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.286277 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.286439 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.286587 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.286730 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.286907 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.287057 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.287220 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.287378 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.287552 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.287707 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.287852 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.287995 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.288150 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.288296 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.288448 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.288600 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.288743 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.288887 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.289041 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.289198 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.289351 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.289495 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.289640 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.289791 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.289944 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.290088 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.290233 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.290386 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.290537 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.290690 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.290882 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.291034 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.291190 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.291351 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.291505 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.291659 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.291813 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.291958 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.292101 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.292246 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.292391 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.292543 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.292697 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.292841 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.292983 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.293148 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.293294 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.293447 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.293591 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.293734 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.293877 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.294020 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.294171 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.294315 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.294467 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.294611 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.294754 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.294925 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.295093 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.295240 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.295393 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.295540 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.295697 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.295842 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.295999 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.296144 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.296288 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.296432 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.296576 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.296720 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.296887 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.297032 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.297175 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.297318 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.297463 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.297617 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.297769 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.297921 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.298066 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.298209 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.298352 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.298504 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.298660 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.298866 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.299030 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.299176 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.299327 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.299485 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.299632 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.299784 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.299936 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.300080 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.300224 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.300376 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.300522 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.300667 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.300829 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.300974 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.301192 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.301339 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.301483 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.301626 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.301781 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.301926 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.302078 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.302223 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.302368 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.302511 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.302674 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.302850 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.303014 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.303222 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.303375 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.303529 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.303676 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.303834 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.303981 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.304126 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.304270 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.304445 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.304610 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.304780 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.304935 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.305088 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.305235 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.305378 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.305536 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.305682 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.305833 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.306007 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.306162 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.306319 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.306476 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.306629 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.306773 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.306978 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.307124 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.307284 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.307432 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.307583 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.307728 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.307871 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.308024 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.308177 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.308334 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.308478 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.308622 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.308765 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.308908 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.309061 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.309208 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.309352 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.309496 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.309639 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.309791 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.309935 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.310089 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.310234 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.310377 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.310564 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.310723 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.310900 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.311048 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.311192 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.311335 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.311511 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.311678 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.311834 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.311992 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.312243 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.312402 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.312548 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.312705 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.312851 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.312994 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.313147 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.313294 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.313449 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.313601 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.313747 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.313900 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.314064 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.314209 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.314362 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.314521 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.314666 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.314862 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.315013 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.315157 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.315315 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.315461 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.315604 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.315747 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.315890 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.316054 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.316279 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.316439 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.316586 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.316738 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.316882 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.317033 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.317178 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.317322 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.317466 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.317610 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.317851 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.318011 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.318168 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.318312 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.318456 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.318600 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.318787 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.318981 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.319128 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.319271 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.319423 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.319592 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.319757 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.319912 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.320071 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.320215 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.320358 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.320510 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.320663 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.320809 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.320959 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.321104 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.321248 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.321399 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.321552 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.321704 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.321849 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.322018 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.322173 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.322318 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.322470 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.322615 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.322758 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.322956 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.323102 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.323262 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.323408 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.323552 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.323697 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.323841 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.324004 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.324157 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.324303 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.324446 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.324598 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.324754 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.324897 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.325049 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.325194 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.325347 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.325491 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.325634 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.325778 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.325946 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.326091 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.326091 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.326364 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.326507 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.326650 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.326824 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.326977 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.327122 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.327267 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.327422 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.327580 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.327725 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.327880 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.327880 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.328170 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.328314 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.328467 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.328622 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.328767 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.328910 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.329054 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.329204 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.329430 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.329430 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.329730 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.329874 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.330018 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.330169 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.330322 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.330467 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.330610 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.330754 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.330947 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.331107 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.331261 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.331406 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.331549 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.331710 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.331854 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.332017 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.332165 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.332316 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.332460 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.332612 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.332757 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.332909 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.333055 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.333219 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.333365 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.333517 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.333686 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.333840 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.333984 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.334128 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.334272 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.334478 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.334640 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.334787 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.334960 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.335105 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.335251 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.335396 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.335562 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.335709 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.335854 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.335998 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.336143 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.336298 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.336445 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.336589 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.336733 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.336878 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.337030 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.337185 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.337350 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.337496 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.337640 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.337783 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.337927 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.338084 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.338230 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.338375 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.338520 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.338664 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.338829 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.338996 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.339142 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.339299 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.339444 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.339596 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.339750 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.339895 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.340046 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.340192 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.340335 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.340480 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.340636 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.340780 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.340924 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.341078 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.341222 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.341469 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.341634 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.341792 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.341936 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.342089 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.342234 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.342392 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.342540 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.342684 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.342921 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.343075 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.343242 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.343451 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.343658 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.343811 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.343978 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.344129 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.344296 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.344462 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.344609 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.344754 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.344906 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.345059 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.345227 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.345373 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.345516 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.345661 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.345831 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.345982 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.346135 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.346281 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.346433 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.346577 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.346757 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.346994 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.347121 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.347209 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.347420 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.347553 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.347705 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.347912 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.348102 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.348260 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.348405 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.348550 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.348703 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.348861 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.349008 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.349165 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.349308 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.349451 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.349595 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.349747 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.349892 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.350403 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.350548 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.350701 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.350874 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.351040 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.351196 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.351349 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.351505 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.351650 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.351806 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.351952 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.352097 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.352240 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.352384 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.352527 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.352695 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.352843 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.352989 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.353145 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.353292 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.353461 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.353616 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.353762 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.353906 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.354051 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.354203 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.354347 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.354500 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.354646 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.354789 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.354988 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.355144 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.355311 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.355457 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.355601 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.355744 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.355887 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.356039 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.356197 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.356344 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.356488 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.356639 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.356784 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.356927 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.357109 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.357268 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.357413 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.357556 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.357699 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.357841 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.358061 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.358208 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.358353 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.358497 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.358639 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.358791 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.358963 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.359119 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.359276 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.359428 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.359581 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.359734 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.359879 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.360031 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.360176 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.360320 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.360474 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.360632 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.360779 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.360921 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.361090 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.361236 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.361388 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.361540 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.361686 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.361828 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.361971 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.362114 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.362265 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.362410 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.362571 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.362720 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.362921 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.363082 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.363239 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.363385 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.363530 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.363683 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.363836 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.363991 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.364137 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.364281 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.364424 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.364567 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.364720 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.364884 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.365030 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.365173 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.365316 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.365460 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.365625 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.365812 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.365961 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.366106 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.366257 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.366402 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.366556 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.366713 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.366873 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.367024 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.367168 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.367312 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.367467 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.367614 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.367759 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.367955 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.368111 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.368255 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.368408 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.368553 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.368715 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.368862 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.369014 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.369160 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 03 03:40:49.369314 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.369314 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.369314 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.369726 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.369919 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.370236 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.370542 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:40:49.370785 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 03 03:40:49.520819 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO dbcounter [None req-6c0ef6b3-27e7-4240-8daa-c915e8534d29 None None] Registered counter for database nova_api Sep 03 03:40:49.523211 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO dbcounter [None req-ed1052c4-305b-4822-ad98-1642bb0f2957 None None] Registered counter for database nova_api Sep 03 03:40:49.543544 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG oslo_db.sqlalchemy.engines [None req-6c0ef6b3-27e7-4240-8daa-c915e8534d29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117084) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 03:40:49.545290 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG oslo_db.sqlalchemy.engines [None req-ed1052c4-305b-4822-ad98-1642bb0f2957 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117085) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 03:40:49.550958 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG dbcounter [-] [117084] Writer thread running {{(pid=117084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 03:40:49.552104 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG dbcounter [-] [117085] Writer thread running {{(pid=117085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 03:40:49.607162 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.context [None req-ed1052c4-305b-4822-ad98-1642bb0f2957 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f0044725-3830-4c39-ba2b-0d5fbf875774(cell1) {{(pid=117085) load_cells /opt/stack/nova/nova/context.py:464}} Sep 03 03:40:49.607382 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.context [None req-6c0ef6b3-27e7-4240-8daa-c915e8534d29 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f0044725-3830-4c39-ba2b-0d5fbf875774(cell1) {{(pid=117084) load_cells /opt/stack/nova/nova/context.py:464}} Sep 03 03:40:49.611063 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG oslo_concurrency.lockutils [None req-6c0ef6b3-27e7-4240-8daa-c915e8534d29 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:40:49.611218 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG oslo_concurrency.lockutils [None req-ed1052c4-305b-4822-ad98-1642bb0f2957 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:40:49.611527 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG oslo_concurrency.lockutils [None req-6c0ef6b3-27e7-4240-8daa-c915e8534d29 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:40:49.611674 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG oslo_concurrency.lockutils [None req-ed1052c4-305b-4822-ad98-1642bb0f2957 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:40:49.613059 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG oslo_concurrency.lockutils [None req-6c0ef6b3-27e7-4240-8daa-c915e8534d29 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:40:49.613210 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG oslo_concurrency.lockutils [None req-ed1052c4-305b-4822-ad98-1642bb0f2957 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:40:49.613810 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG oslo_concurrency.lockutils [None req-ed1052c4-305b-4822-ad98-1642bb0f2957 None None] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:40:49.613955 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG oslo_concurrency.lockutils [None req-6c0ef6b3-27e7-4240-8daa-c915e8534d29 None None] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:40:49.614212 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG oslo_concurrency.lockutils [None req-6c0ef6b3-27e7-4240-8daa-c915e8534d29 None None] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:40:49.614320 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG oslo_concurrency.lockutils [None req-ed1052c4-305b-4822-ad98-1642bb0f2957 None None] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:40:49.616255 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG oslo_concurrency.lockutils [None req-6c0ef6b3-27e7-4240-8daa-c915e8534d29 None None] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:40:49.616392 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG oslo_concurrency.lockutils [None req-ed1052c4-305b-4822-ad98-1642bb0f2957 None None] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:40:49.618293 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO dbcounter [None req-ed1052c4-305b-4822-ad98-1642bb0f2957 None None] Registered counter for database nova_cell0 Sep 03 03:40:49.618430 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO dbcounter [None req-6c0ef6b3-27e7-4240-8daa-c915e8534d29 None None] Registered counter for database nova_cell0 Sep 03 03:40:49.622210 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO dbcounter [None req-6c0ef6b3-27e7-4240-8daa-c915e8534d29 None None] Registered counter for database nova_cell1 Sep 03 03:40:49.622599 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO dbcounter [None req-ed1052c4-305b-4822-ad98-1642bb0f2957 None None] Registered counter for database nova_cell1 Sep 03 03:40:49.630418 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG oslo_db.sqlalchemy.engines [None req-6c0ef6b3-27e7-4240-8daa-c915e8534d29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117084) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 03:40:49.632711 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG oslo_db.sqlalchemy.engines [None req-6c0ef6b3-27e7-4240-8daa-c915e8534d29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117084) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 03:40:49.634511 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG oslo_db.sqlalchemy.engines [None req-ed1052c4-305b-4822-ad98-1642bb0f2957 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117085) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 03:40:49.635842 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG oslo_db.sqlalchemy.engines [None req-ed1052c4-305b-4822-ad98-1642bb0f2957 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117085) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 03:40:49.636936 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG dbcounter [-] [117084] Writer thread running {{(pid=117084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 03:40:49.641844 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG dbcounter [-] [117085] Writer thread running {{(pid=117085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 03:40:49.769510 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG dbcounter [-] [117084] Writer thread running {{(pid=117084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 03:40:49.776295 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG dbcounter [-] [117085] Writer thread running {{(pid=117085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 03:40:49.780103 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO dbcounter [None req-6c0ef6b3-27e7-4240-8daa-c915e8534d29 None None] Registered counter for database nova_cell0 Sep 03 03:40:49.786791 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO dbcounter [None req-ed1052c4-305b-4822-ad98-1642bb0f2957 None None] Registered counter for database nova_cell0 Sep 03 03:40:49.788141 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG oslo_db.sqlalchemy.engines [None req-6c0ef6b3-27e7-4240-8daa-c915e8534d29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117084) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 03:40:49.792624 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG dbcounter [-] [117084] Writer thread running {{(pid=117084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 03:40:49.795754 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG oslo_db.sqlalchemy.engines [None req-ed1052c4-305b-4822-ad98-1642bb0f2957 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117085) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 03:40:49.800980 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG dbcounter [-] [117085] Writer thread running {{(pid=117085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 03:40:50.125900 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: WARNING keystonemiddleware.auth_token [None req-ed1052c4-305b-4822-ad98-1642bb0f2957 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 03 03:40:50.128855 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: WARNING keystonemiddleware.auth_token [None req-6c0ef6b3-27e7-4240-8daa-c915e8534d29 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 03 03:40:50.133240 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: WARNING keystonemiddleware.auth_token [None req-ed1052c4-305b-4822-ad98-1642bb0f2957 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 03 03:40:50.136141 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: WARNING keystonemiddleware.auth_token [None req-6c0ef6b3-27e7-4240-8daa-c915e8534d29 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 03 03:40:50.469843 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: WARNING keystonemiddleware.auth_token [None req-ed1052c4-305b-4822-ad98-1642bb0f2957 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 03 03:40:50.476254 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: WARNING keystonemiddleware.auth_token [None req-ed1052c4-305b-4822-ad98-1642bb0f2957 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 03 03:40:50.481499 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5573416a49c0 pid: 117085 (default app) Sep 03 03:40:50.481958 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: WARNING keystonemiddleware.auth_token [None req-6c0ef6b3-27e7-4240-8daa-c915e8534d29 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 03 03:40:50.483566 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-ed1052c4-305b-4822-ad98-1642bb0f2957 None None] Calling method '>' {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:40:50.484753 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-ed1052c4-305b-4822-ad98-1642bb0f2957 None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001745 Sep 03 03:40:50.485160 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 788 bytes} [Sat Sep 3 03:40:50 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:40:50.488043 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: WARNING keystonemiddleware.auth_token [None req-6c0ef6b3-27e7-4240-8daa-c915e8534d29 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 03 03:40:50.493415 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5573416a49c0 pid: 117084 (default app) Sep 03 03:42:08.484360 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-ed1052c4-305b-4822-ad98-1642bb0f2957 None None] Calling method '>' {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:42:08.485999 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-ed1052c4-305b-4822-ad98-1642bb0f2957 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002066 Sep 03 03:42:08.486406 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 2/2] 10.222.0.25 () {54 vars in 931 bytes} [Sat Sep 3 03:42:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:42:08.505770 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG dbcounter [-] [117084] Writing DB stats nova_api:SELECT=3 {{(pid=117084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:08.507142 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG dbcounter [-] [117084] Writing DB stats nova_cell1:SELECT=3 {{(pid=117084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:08.508013 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG dbcounter [-] [117084] Writing DB stats nova_cell0:SELECT=3 {{(pid=117084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:08.509094 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG dbcounter [-] [117084] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=117084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:09.371146 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-45d1b34d-d943-41e5-8904-ff5879d03e7e admin admin] Calling method '>' {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:42:09.403782 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.requestlog [None req-45d1b34d-d943-41e5-8904-ff5879d03e7e admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.910269 Sep 03 03:42:09.404547 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: [pid: 117084|app: 0|req: 1/3] 10.222.0.25 () {60 vars in 1292 bytes} [Sat Sep 3 03:42:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:42:11.743011 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-ed1052c4-305b-4822-ad98-1642bb0f2957 None None] Calling method '>' {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:42:11.743011 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-ed1052c4-305b-4822-ad98-1642bb0f2957 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 03 03:42:11.744829 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 3/4] 10.222.0.25 () {54 vars in 931 bytes} [Sat Sep 3 03:42:11 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:42:12.174777 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-f956cba8-380f-46f0-b9a7-49b02f8af420 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "ram": 256, "vcpus": 1, "disk": 1, "swap": 0, "rxtx_factor": 1.0, "name": "cirros256"}} {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:42:12.224312 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.requestlog [None req-f956cba8-380f-46f0-b9a7-49b02f8af420 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.474841 Sep 03 03:42:12.224912 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: [pid: 117084|app: 0|req: 2/5] 10.222.0.25 () {64 vars in 1283 bytes} [Sat Sep 3 03:42:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 03 03:42:12.239637 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG dbcounter [-] [117085] Writing DB stats nova_api:SELECT=3 {{(pid=117085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:12.242049 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG dbcounter [-] [117085] Writing DB stats nova_cell1:SELECT=3 {{(pid=117085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:12.242865 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG dbcounter [-] [117085] Writing DB stats nova_cell0:SELECT=3 {{(pid=117085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:12.243808 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG dbcounter [-] [117085] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=117085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:12.452745 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-e68f420b-0f2a-43c7-ae56-52fd1f74acc4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:42:12.516282 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-e68f420b-0f2a-43c7-ae56-52fd1f74acc4 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.282573 Sep 03 03:42:12.516882 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 4/6] 10.222.0.25 () {64 vars in 1336 bytes} [Sat Sep 3 03:42:12 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:42:14.878617 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-f956cba8-380f-46f0-b9a7-49b02f8af420 admin admin] Calling method '>' {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:42:14.879688 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.requestlog [None req-f956cba8-380f-46f0-b9a7-49b02f8af420 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Sep 03 03:42:14.880395 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: [pid: 117084|app: 0|req: 3/7] 10.222.0.25 () {54 vars in 931 bytes} [Sat Sep 3 03:42:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:42:15.522463 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-d5562ce7-df8d-43a2-824c-6bba539650f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d1", "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "rxtx_factor": 1.0, "disk": 5, "swap": 0}} {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:42:15.562051 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-d5562ce7-df8d-43a2-824c-6bba539650f2 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.675589 Sep 03 03:42:15.562899 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 5/8] 10.222.0.25 () {64 vars in 1283 bytes} [Sat Sep 3 03:42:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 03:42:15.574543 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-d450a4c4-a954-492c-a304-a1c4c1ed0ae4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:42:15.613720 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.requestlog [None req-d450a4c4-a954-492c-a304-a1c4c1ed0ae4 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042789 Sep 03 03:42:15.622477 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: [pid: 117084|app: 0|req: 4/9] 10.222.0.25 () {64 vars in 1336 bytes} [Sat Sep 3 03:42:15 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:42:17.919101 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-d5562ce7-df8d-43a2-824c-6bba539650f2 admin admin] Calling method '>' {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:42:17.920051 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-d5562ce7-df8d-43a2-824c-6bba539650f2 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Sep 03 03:42:17.920420 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 6/10] 10.222.0.25 () {54 vars in 931 bytes} [Sat Sep 3 03:42:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:42:18.321640 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-a658c2ef-16a9-4072-8d27-95345d5d6460 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "disk": 10, "ram": 1024, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d2", "os-flavor-access:is_public": true}} {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:42:18.342223 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.requestlog [None req-a658c2ef-16a9-4072-8d27-95345d5d6460 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.415484 Sep 03 03:42:18.342788 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: [pid: 117084|app: 0|req: 5/11] 10.222.0.25 () {64 vars in 1283 bytes} [Sat Sep 3 03:42:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 03:42:18.355390 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-d08b029b-6f06-4f0b-ab21-e03f5b42e5cc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:42:18.380228 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-d08b029b-6f06-4f0b-ab21-e03f5b42e5cc admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028579 Sep 03 03:42:18.380751 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 7/12] 10.222.0.25 () {64 vars in 1336 bytes} [Sat Sep 3 03:42:18 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:42:20.723126 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-a658c2ef-16a9-4072-8d27-95345d5d6460 admin admin] Calling method '>' {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:42:20.724229 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.requestlog [None req-a658c2ef-16a9-4072-8d27-95345d5d6460 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001822 Sep 03 03:42:20.724579 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: [pid: 117084|app: 0|req: 6/13] 10.222.0.25 () {54 vars in 931 bytes} [Sat Sep 3 03:42:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:42:21.182420 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-d75e6901-261b-42db-bc6f-be457fd86215 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d3", "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "vcpus": 2, "disk": 10, "rxtx_factor": 1.0}} {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:42:21.203970 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-d75e6901-261b-42db-bc6f-be457fd86215 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.471522 Sep 03 03:42:21.204610 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 8/14] 10.222.0.25 () {64 vars in 1283 bytes} [Sat Sep 3 03:42:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 03:42:21.216943 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-3879acb3-6b6c-470e-b2ea-53958eb920c5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:42:21.254407 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.requestlog [None req-3879acb3-6b6c-470e-b2ea-53958eb920c5 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040986 Sep 03 03:42:21.264324 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: [pid: 117084|app: 0|req: 7/15] 10.222.0.25 () {64 vars in 1336 bytes} [Sat Sep 3 03:42:21 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:42:23.577584 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-d75e6901-261b-42db-bc6f-be457fd86215 admin admin] Calling method '>' {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:42:23.578595 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-d75e6901-261b-42db-bc6f-be457fd86215 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Sep 03 03:42:23.579000 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 9/16] 10.222.0.25 () {54 vars in 931 bytes} [Sat Sep 3 03:42:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:42:24.012753 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-75fe2ae4-1f76-452c-b566-417f91fa7598 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "disk": 20, "ram": 4096, "name": "ds4G", "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:42:24.033301 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.requestlog [None req-75fe2ae4-1f76-452c-b566-417f91fa7598 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.447911 Sep 03 03:42:24.034400 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: [pid: 117084|app: 0|req: 8/17] 10.222.0.25 () {64 vars in 1283 bytes} [Sat Sep 3 03:42:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 03 03:42:24.046879 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-cb3d6e54-1530-4006-b57f-8847ddafd544 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:42:24.075823 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-cb3d6e54-1530-4006-b57f-8847ddafd544 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033044 Sep 03 03:42:24.076813 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 10/18] 10.222.0.25 () {64 vars in 1336 bytes} [Sat Sep 3 03:42:24 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:42:26.459280 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-75fe2ae4-1f76-452c-b566-417f91fa7598 admin admin] Calling method '>' {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:42:26.460340 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.requestlog [None req-75fe2ae4-1f76-452c-b566-417f91fa7598 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001576 Sep 03 03:42:26.460767 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: [pid: 117084|app: 0|req: 9/19] 10.222.0.25 () {54 vars in 931 bytes} [Sat Sep 3 03:42:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:42:26.891779 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-c8a5e28c-9bcf-40e3-a1b5-c701eeaa1479 admin admin] Calling method '>' {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:42:26.916289 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-c8a5e28c-9bcf-40e3-a1b5-c701eeaa1479 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.449192 Sep 03 03:42:26.916831 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 11/20] 10.222.0.25 () {60 vars in 1292 bytes} [Sat Sep 3 03:42:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:42:29.245930 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-75fe2ae4-1f76-452c-b566-417f91fa7598 admin admin] Calling method '>' {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:42:29.247151 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.requestlog [None req-75fe2ae4-1f76-452c-b566-417f91fa7598 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001708 Sep 03 03:42:29.247609 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: [pid: 117084|app: 0|req: 10/21] 10.222.0.25 () {54 vars in 931 bytes} [Sat Sep 3 03:42:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:42:29.664630 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-8d2535fd-d9d5-4fd7-91c4-4102e18fd155 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.tiny", "vcpus": 1, "swap": 0, "id": "1"}} {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:42:29.683971 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-8d2535fd-d9d5-4fd7-91c4-4102e18fd155 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.429564 Sep 03 03:42:29.684525 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 12/22] 10.222.0.25 () {64 vars in 1283 bytes} [Sat Sep 3 03:42:29 2022] POST /compute/v2.1/flavors => generated 402 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 03:42:29.697371 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-5eb513d5-023b-4da2-82cd-97d5ab9c79b1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:42:29.721697 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.requestlog [None req-5eb513d5-023b-4da2-82cd-97d5ab9c79b1 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028029 Sep 03 03:42:29.722258 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: [pid: 117084|app: 0|req: 11/23] 10.222.0.25 () {64 vars in 1333 bytes} [Sat Sep 3 03:42:29 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:42:32.176525 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-8d2535fd-d9d5-4fd7-91c4-4102e18fd155 admin admin] Calling method '>' {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:42:32.177465 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-8d2535fd-d9d5-4fd7-91c4-4102e18fd155 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Sep 03 03:42:32.177906 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 931 bytes} [Sat Sep 3 03:42:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:42:32.582245 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-969870f6-5bab-4f75-831a-e7547e0f31d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "swap": 0, "vcpus": 1, "name": "m1.small", "id": "2"}} {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:42:32.602724 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.requestlog [None req-969870f6-5bab-4f75-831a-e7547e0f31d3 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.418419 Sep 03 03:42:32.603331 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: [pid: 117084|app: 0|req: 12/25] 10.222.0.25 () {64 vars in 1283 bytes} [Sat Sep 3 03:42:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 03:42:32.615607 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-e36c5b4d-d740-4d36-9100-19bdff193a28 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:42:32.643001 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-e36c5b4d-d740-4d36-9100-19bdff193a28 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031197 Sep 03 03:42:32.643563 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 14/26] 10.222.0.25 () {64 vars in 1333 bytes} [Sat Sep 3 03:42:32 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:42:34.963854 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-969870f6-5bab-4f75-831a-e7547e0f31d3 admin admin] Calling method '>' {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:42:34.964876 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.requestlog [None req-969870f6-5bab-4f75-831a-e7547e0f31d3 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Sep 03 03:42:34.965278 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: [pid: 117084|app: 0|req: 13/27] 10.222.0.25 () {54 vars in 931 bytes} [Sat Sep 3 03:42:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:42:35.375407 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-20a71609-82f9-4dba-811e-8cb8145576b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2, "ram": 4096, "id": "3", "name": "m1.medium", "swap": 0, "disk": 40}} {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:42:35.399039 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-20a71609-82f9-4dba-811e-8cb8145576b6 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.427413 Sep 03 03:42:35.399910 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 15/28] 10.222.0.25 () {64 vars in 1283 bytes} [Sat Sep 3 03:42:34 2022] POST /compute/v2.1/flavors => generated 406 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 03:42:35.411767 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-ddda0719-48c3-47d4-908b-465734651767 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:42:35.438604 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.requestlog [None req-ddda0719-48c3-47d4-908b-465734651767 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030583 Sep 03 03:42:35.443168 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: [pid: 117084|app: 0|req: 14/29] 10.222.0.25 () {64 vars in 1333 bytes} [Sat Sep 3 03:42:35 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:42:37.797477 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-20a71609-82f9-4dba-811e-8cb8145576b6 admin admin] Calling method '>' {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:42:37.799764 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-20a71609-82f9-4dba-811e-8cb8145576b6 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002754 Sep 03 03:42:37.800683 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 16/30] 10.222.0.25 () {54 vars in 931 bytes} [Sat Sep 3 03:42:37 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:42:38.229245 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-03aaef68-57a3-4243-aef8-042ec33d0144 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 4, "ram": 8192, "disk": 80, "swap": 0, "os-flavor-access:is_public": true, "id": "4", "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:42:38.252569 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.requestlog [None req-03aaef68-57a3-4243-aef8-042ec33d0144 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.438582 Sep 03 03:42:38.253484 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: [pid: 117084|app: 0|req: 15/31] 10.222.0.25 () {64 vars in 1283 bytes} [Sat Sep 3 03:42:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 03 03:42:38.265703 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-e911a51b-de6c-45f0-b740-160338e3ac58 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:42:38.290475 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-e911a51b-de6c-45f0-b740-160338e3ac58 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028601 Sep 03 03:42:38.291304 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 17/32] 10.222.0.25 () {64 vars in 1333 bytes} [Sat Sep 3 03:42:38 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:42:40.661727 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-03aaef68-57a3-4243-aef8-042ec33d0144 admin admin] Calling method '>' {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:42:40.663037 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.requestlog [None req-03aaef68-57a3-4243-aef8-042ec33d0144 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001729 Sep 03 03:42:40.663433 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: [pid: 117084|app: 0|req: 16/33] 10.222.0.25 () {54 vars in 931 bytes} [Sat Sep 3 03:42:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:42:41.106856 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-639813da-ff0e-4ccf-80f8-e734f2da97e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "os-flavor-access:is_public": true, "swap": 0, "ram": 16384, "name": "m1.xlarge", "rxtx_factor": 1.0, "disk": 160}} {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:42:41.126948 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-639813da-ff0e-4ccf-80f8-e734f2da97e1 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.457026 Sep 03 03:42:41.134460 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 18/34] 10.222.0.25 () {64 vars in 1283 bytes} [Sat Sep 3 03:42:40 2022] POST /compute/v2.1/flavors => generated 408 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 03:42:41.139530 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-e5ecfc52-f0b8-470c-bb86-f32f557299b0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:42:41.147703 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG dbcounter [-] [117084] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=117084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:41.167892 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.requestlog [None req-e5ecfc52-f0b8-470c-bb86-f32f557299b0 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032050 Sep 03 03:42:41.168605 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: [pid: 117084|app: 0|req: 17/35] 10.222.0.25 () {64 vars in 1333 bytes} [Sat Sep 3 03:42:41 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:42:59.522297 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-639813da-ff0e-4ccf-80f8-e734f2da97e1 admin admin] Calling method '>' {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:42:59.523796 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-639813da-ff0e-4ccf-80f8-e734f2da97e1 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002258 Sep 03 03:42:59.524446 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 19/36] 10.222.0.25 () {54 vars in 931 bytes} [Sat Sep 3 03:42:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:42:59.539246 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG dbcounter [-] [117084] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=117084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:59.969631 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-2cc95772-6e94-42cb-bcad-066e8ec8e5c7 admin admin] Calling method '>' {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:42:59.993425 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.requestlog [None req-2cc95772-6e94-42cb-bcad-066e8ec8e5c7 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.458784 Sep 03 03:42:59.993971 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: [pid: 117084|app: 0|req: 18/37] 10.222.0.25 () {60 vars in 1292 bytes} [Sat Sep 3 03:42:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:43:01.046646 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-639813da-ff0e-4ccf-80f8-e734f2da97e1 admin admin] Calling method '>' {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:43:01.047693 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-639813da-ff0e-4ccf-80f8-e734f2da97e1 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Sep 03 03:43:01.048092 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 20/38] 10.222.0.25 () {56 vars in 1074 bytes} [Sat Sep 3 03:43:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:43:01.601521 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-805fb60a-a00b-447b-967e-3552c64cade1 admin admin] Calling method '>' {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:43:01.607417 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.wsgi [None req-805fb60a-a00b-447b-967e-3552c64cade1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 03 03:43:01.610629 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-805fb60a-a00b-447b-967e-3552c64cade1 admin admin] Request method failure captured: Sep 03 03:43:01.610629 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 03 03:43:01.610629 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: Accept: application/json Sep 03 03:43:01.610629 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: Accept-Encoding: gzip, deflate Sep 03 03:43:01.610629 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: Connection: keep-alive Sep 03 03:43:01.610629 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: Content-Length: 0 Sep 03 03:43:01.610629 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: Host: 10.222.0.25 Sep 03 03:43:01.610629 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: Openstack-Api-Version: compute 2.92 Sep 03 03:43:01.610629 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: Openstack-System-Scope: None Sep 03 03:43:01.610629 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: User-Agent: python-novaclient Sep 03 03:43:01.610629 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Auth-Token: gAAAAABjEs1EYTe7qgk9f32rG_z-XJ2SopkniF537CpaLb4Kr7wC7UMmy77wECn9CfXhQva0ktNgCHyxq-mvBBGpqYzcCQtZAIy2csvEN8NdkC0nwDK-kFH6Y0l_YH0srNawb5QqbIbPSO9q22RlMixXlwwd94yEpceSB9WgPiAw-CTFy6T2mTU Sep 03 03:43:01.610629 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Domain-Id: None Sep 03 03:43:01.610629 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Domain-Name: None Sep 03 03:43:01.610629 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Identity-Status: Confirmed Sep 03 03:43:01.610629 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Is-Admin-Project: True Sep 03 03:43:01.610629 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Openstack-Nova-Api-Version: 2.92 Sep 03 03:43:01.610629 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Project-Domain-Id: default Sep 03 03:43:01.610629 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Project-Domain-Name: Default Sep 03 03:43:01.610629 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Project-Id: 1fa3555aedbc4a4eaa2e41bd6d2eeab3 Sep 03 03:43:01.610629 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Project-Name: admin Sep 03 03:43:01.610629 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Role: member,reader,admin Sep 03 03:43:01.610629 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Roles: member,reader,admin Sep 03 03:43:01.612035 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1fa3555aedbc4a4eaa2e41bd6d2eeab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1fa3555aedbc4a4eaa2e41bd6d2eeab3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1fa3555aedbc4a4eaa2e41bd6d2eeab3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1fa3555aedbc4a4eaa2e41bd6d2eeab3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:43:01.612035 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Tenant: admin Sep 03 03:43:01.612035 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Tenant-Id: 1fa3555aedbc4a4eaa2e41bd6d2eeab3 Sep 03 03:43:01.612035 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Tenant-Name: admin Sep 03 03:43:01.612035 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-User: admin Sep 03 03:43:01.612035 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-User-Domain-Id: default Sep 03 03:43:01.612035 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-User-Domain-Name: Default Sep 03 03:43:01.612035 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-User-Id: 5009c224905e4768b33c681c0f95b0f8 Sep 03 03:43:01.612035 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-User-Name: admin Sep 03 03:43:01.612035 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: method: > Sep 03 03:43:01.612035 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: exception: Flavor 42 could not be found. Sep 03 03:43:01.612035 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: action_args: {'id': '42'} Sep 03 03:43:01.612035 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:43:01.612035 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:43:01.612884 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 03 03:43:01.612884 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 03 03:43:01.612884 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 03 03:43:01.612884 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 03 03:43:01.612884 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 03:43:01.612884 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 03:43:01.612884 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 03 03:43:01.612884 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 03 03:43:01.612884 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 03 03:43:01.612884 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:43:01.612884 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 03 03:43:01.612884 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 03 03:43:01.612884 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 03 03:43:01.612884 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi Sep 03 03:43:01.612884 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:43:01.612884 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi Sep 03 03:43:01.612884 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:43:01.612884 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:43:01.612884 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:43:01.614135 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:43:01.614135 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:43:01.614135 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:43:01.614135 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:43:01.614135 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 03 03:43:01.614135 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:43:01.614135 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 03 03:43:01.614135 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi Sep 03 03:43:01.614135 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:43:01.614135 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi Sep 03 03:43:01.614135 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:43:01.614135 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:43:01.614135 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:43:01.614135 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:43:01.614135 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:43:01.614135 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 03 03:43:01.614135 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi Sep 03 03:43:01.614135 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-805fb60a-a00b-447b-967e-3552c64cade1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=117084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:43:01.615195 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.requestlog [None req-805fb60a-a00b-447b-967e-3552c64cade1 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.429282 Sep 03 03:43:01.615195 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: [pid: 117084|app: 0|req: 19/39] 10.222.0.25 () {60 vars in 1190 bytes} [Sat Sep 3 03:43:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 430 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 03 03:43:01.621974 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-fd9257e1-f208-4b0d-bd77-0606a6002f7e admin admin] Calling method '>' {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:43:01.626193 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG dbcounter [-] [117085] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=117085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:01.645416 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-fd9257e1-f208-4b0d-bd77-0606a6002f7e admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027043 Sep 03 03:43:01.645973 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 21/40] 10.222.0.25 () {60 vars in 1210 bytes} [Sat Sep 3 03:43:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:43:01.656124 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-af02fb72-5224-45fe-9fef-c6163ef5a2f8 admin admin] Calling method '>' {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:43:01.678530 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.requestlog [None req-af02fb72-5224-45fe-9fef-c6163ef5a2f8 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025954 Sep 03 03:43:01.679070 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: [pid: 117084|app: 0|req: 20/41] 10.222.0.25 () {60 vars in 1210 bytes} [Sat Sep 3 03:43:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:43:01.689397 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-71b078fc-a614-4090-b447-981720bf79df admin admin] Calling method '>' {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:43:01.695709 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.wsgi [None req-71b078fc-a614-4090-b447-981720bf79df admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 03 03:43:01.698990 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-71b078fc-a614-4090-b447-981720bf79df admin admin] Request method failure captured: Sep 03 03:43:01.698990 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 03 03:43:01.698990 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: Accept: application/json Sep 03 03:43:01.698990 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: Accept-Encoding: gzip, deflate Sep 03 03:43:01.698990 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: Connection: keep-alive Sep 03 03:43:01.698990 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: Content-Length: 0 Sep 03 03:43:01.698990 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: Host: 10.222.0.25 Sep 03 03:43:01.698990 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: Openstack-Api-Version: compute 2.92 Sep 03 03:43:01.698990 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: Openstack-System-Scope: None Sep 03 03:43:01.698990 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: User-Agent: python-novaclient Sep 03 03:43:01.698990 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Auth-Token: gAAAAABjEs1EYTe7qgk9f32rG_z-XJ2SopkniF537CpaLb4Kr7wC7UMmy77wECn9CfXhQva0ktNgCHyxq-mvBBGpqYzcCQtZAIy2csvEN8NdkC0nwDK-kFH6Y0l_YH0srNawb5QqbIbPSO9q22RlMixXlwwd94yEpceSB9WgPiAw-CTFy6T2mTU Sep 03 03:43:01.698990 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Domain-Id: None Sep 03 03:43:01.698990 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Domain-Name: None Sep 03 03:43:01.698990 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Identity-Status: Confirmed Sep 03 03:43:01.698990 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Is-Admin-Project: True Sep 03 03:43:01.698990 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Openstack-Nova-Api-Version: 2.92 Sep 03 03:43:01.698990 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Project-Domain-Id: default Sep 03 03:43:01.698990 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Project-Domain-Name: Default Sep 03 03:43:01.698990 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Project-Id: 1fa3555aedbc4a4eaa2e41bd6d2eeab3 Sep 03 03:43:01.698990 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Project-Name: admin Sep 03 03:43:01.698990 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Role: member,reader,admin Sep 03 03:43:01.698990 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Roles: member,reader,admin Sep 03 03:43:01.700551 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1fa3555aedbc4a4eaa2e41bd6d2eeab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1fa3555aedbc4a4eaa2e41bd6d2eeab3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1fa3555aedbc4a4eaa2e41bd6d2eeab3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1fa3555aedbc4a4eaa2e41bd6d2eeab3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:43:01.700551 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Tenant: admin Sep 03 03:43:01.700551 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Tenant-Id: 1fa3555aedbc4a4eaa2e41bd6d2eeab3 Sep 03 03:43:01.700551 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Tenant-Name: admin Sep 03 03:43:01.700551 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-User: admin Sep 03 03:43:01.700551 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-User-Domain-Id: default Sep 03 03:43:01.700551 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-User-Domain-Name: Default Sep 03 03:43:01.700551 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-User-Id: 5009c224905e4768b33c681c0f95b0f8 Sep 03 03:43:01.700551 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-User-Name: admin Sep 03 03:43:01.700551 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: method: > Sep 03 03:43:01.700551 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: exception: Flavor 42 could not be found. Sep 03 03:43:01.700551 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: action_args: {'id': '42'} Sep 03 03:43:01.700551 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:43:01.700551 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:43:01.701455 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 03 03:43:01.701455 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 03 03:43:01.701455 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 03 03:43:01.701455 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 03 03:43:01.701455 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 03:43:01.701455 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 03:43:01.701455 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 03 03:43:01.701455 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 03 03:43:01.701455 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 03 03:43:01.701455 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:43:01.701455 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 03 03:43:01.701455 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 03 03:43:01.701455 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 03 03:43:01.701455 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi Sep 03 03:43:01.701455 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:43:01.701455 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi Sep 03 03:43:01.701455 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:43:01.701455 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:43:01.701455 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:43:01.702519 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:43:01.702519 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:43:01.702519 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:43:01.702519 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:43:01.702519 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 03 03:43:01.702519 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:43:01.702519 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 03 03:43:01.702519 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi Sep 03 03:43:01.702519 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:43:01.702519 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi Sep 03 03:43:01.702519 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:43:01.702519 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:43:01.702519 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:43:01.702519 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:43:01.702519 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:43:01.702519 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 03 03:43:01.702519 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi Sep 03 03:43:01.702519 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-71b078fc-a614-4090-b447-981720bf79df admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=117085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:43:01.703522 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-71b078fc-a614-4090-b447-981720bf79df admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015138 Sep 03 03:43:01.703522 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 22/42] 10.222.0.25 () {60 vars in 1190 bytes} [Sat Sep 3 03:43:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 03 03:43:02.684055 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-af02fb72-5224-45fe-9fef-c6163ef5a2f8 admin admin] Calling method '>' {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:43:02.685102 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.requestlog [None req-af02fb72-5224-45fe-9fef-c6163ef5a2f8 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Sep 03 03:43:02.685499 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: [pid: 117084|app: 0|req: 21/43] 10.222.0.25 () {56 vars in 1074 bytes} [Sat Sep 3 03:43:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:43:03.233025 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-49f73327-41e9-428a-8fc3-2bf5ac8f2240 admin admin] Calling method '>' {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:43:03.238675 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.wsgi [None req-49f73327-41e9-428a-8fc3-2bf5ac8f2240 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 03 03:43:03.240253 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-49f73327-41e9-428a-8fc3-2bf5ac8f2240 admin admin] Request method failure captured: Sep 03 03:43:03.240253 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 03 03:43:03.240253 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: Accept: application/json Sep 03 03:43:03.240253 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: Accept-Encoding: gzip, deflate Sep 03 03:43:03.240253 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: Connection: keep-alive Sep 03 03:43:03.240253 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: Content-Length: 0 Sep 03 03:43:03.240253 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: Host: 10.222.0.25 Sep 03 03:43:03.240253 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: Openstack-Api-Version: compute 2.92 Sep 03 03:43:03.240253 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: Openstack-System-Scope: None Sep 03 03:43:03.240253 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: User-Agent: python-novaclient Sep 03 03:43:03.240253 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Auth-Token: gAAAAABjEs1GgY7gAzU61CkKwB7qKd4wIqEJcmioh9XVB5pgThCUi71eoZJ026t7nlTWzACxLrlQMos5ahqp70Cx4rSF8owKwARkOgUON7mczBewalYbDPOfS09Gko_lLdfcNMYvsC6AO2YxVaVdA7RpPMNQCunl5iHeMzXj9GLNpibu7pHVjTw Sep 03 03:43:03.240253 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Domain-Id: None Sep 03 03:43:03.240253 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Domain-Name: None Sep 03 03:43:03.240253 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Identity-Status: Confirmed Sep 03 03:43:03.240253 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Is-Admin-Project: True Sep 03 03:43:03.240253 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Openstack-Nova-Api-Version: 2.92 Sep 03 03:43:03.240253 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Project-Domain-Id: default Sep 03 03:43:03.240253 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Project-Domain-Name: Default Sep 03 03:43:03.240253 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Project-Id: 1fa3555aedbc4a4eaa2e41bd6d2eeab3 Sep 03 03:43:03.240253 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Project-Name: admin Sep 03 03:43:03.240253 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Role: member,reader,admin Sep 03 03:43:03.240253 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Roles: member,reader,admin Sep 03 03:43:03.241808 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1fa3555aedbc4a4eaa2e41bd6d2eeab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1fa3555aedbc4a4eaa2e41bd6d2eeab3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1fa3555aedbc4a4eaa2e41bd6d2eeab3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1fa3555aedbc4a4eaa2e41bd6d2eeab3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:43:03.241808 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Tenant: admin Sep 03 03:43:03.241808 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Tenant-Id: 1fa3555aedbc4a4eaa2e41bd6d2eeab3 Sep 03 03:43:03.241808 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Tenant-Name: admin Sep 03 03:43:03.241808 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-User: admin Sep 03 03:43:03.241808 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-User-Domain-Id: default Sep 03 03:43:03.241808 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-User-Domain-Name: Default Sep 03 03:43:03.241808 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-User-Id: 5009c224905e4768b33c681c0f95b0f8 Sep 03 03:43:03.241808 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-User-Name: admin Sep 03 03:43:03.241808 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: method: > Sep 03 03:43:03.241808 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: exception: Flavor 84 could not be found. Sep 03 03:43:03.241808 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: action_args: {'id': '84'} Sep 03 03:43:03.241808 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:43:03.241808 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:43:03.242643 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 03 03:43:03.242643 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 03 03:43:03.242643 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 03 03:43:03.242643 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 03 03:43:03.242643 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 03:43:03.242643 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 03:43:03.242643 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 03 03:43:03.242643 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 03 03:43:03.242643 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 03 03:43:03.242643 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:43:03.242643 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 03 03:43:03.242643 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 03 03:43:03.242643 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 03 03:43:03.242643 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi Sep 03 03:43:03.242643 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:43:03.242643 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi Sep 03 03:43:03.242643 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:43:03.242643 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:43:03.242643 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:43:03.243739 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:43:03.243739 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:43:03.243739 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:43:03.243739 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:43:03.243739 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 03 03:43:03.243739 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:43:03.243739 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 03 03:43:03.243739 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi Sep 03 03:43:03.243739 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:43:03.243739 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi Sep 03 03:43:03.243739 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:43:03.243739 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:43:03.243739 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:43:03.243739 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:43:03.243739 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:43:03.243739 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 03 03:43:03.243739 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi Sep 03 03:43:03.243739 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-49f73327-41e9-428a-8fc3-2bf5ac8f2240 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=117085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:43:03.244911 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-49f73327-41e9-428a-8fc3-2bf5ac8f2240 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.421708 Sep 03 03:43:03.244911 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 23/44] 10.222.0.25 () {60 vars in 1190 bytes} [Sat Sep 3 03:43:02 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 423 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 03 03:43:03.251619 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-2a4e9f83-a4dc-4c34-a6b3-7e27dd3667f2 admin admin] Calling method '>' {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:43:03.266886 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.requestlog [None req-2a4e9f83-a4dc-4c34-a6b3-7e27dd3667f2 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018814 Sep 03 03:43:03.267442 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: [pid: 117084|app: 0|req: 22/45] 10.222.0.25 () {60 vars in 1210 bytes} [Sat Sep 3 03:43:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:43:03.277455 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-afad82eb-67c2-4684-9405-3aaff5a34401 admin admin] Calling method '>' {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:43:03.292764 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-afad82eb-67c2-4684-9405-3aaff5a34401 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018987 Sep 03 03:43:03.293320 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 24/46] 10.222.0.25 () {60 vars in 1210 bytes} [Sat Sep 3 03:43:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:43:03.302431 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-725d3f34-ecbd-475f-be88-cb67da6cfd0c admin admin] Calling method '>' {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:43:03.307978 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.wsgi [None req-725d3f34-ecbd-475f-be88-cb67da6cfd0c admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 03 03:43:03.309456 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-725d3f34-ecbd-475f-be88-cb67da6cfd0c admin admin] Request method failure captured: Sep 03 03:43:03.309456 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 03 03:43:03.309456 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: Accept: application/json Sep 03 03:43:03.309456 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: Accept-Encoding: gzip, deflate Sep 03 03:43:03.309456 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: Connection: keep-alive Sep 03 03:43:03.309456 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: Content-Length: 0 Sep 03 03:43:03.309456 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: Host: 10.222.0.25 Sep 03 03:43:03.309456 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: Openstack-Api-Version: compute 2.92 Sep 03 03:43:03.309456 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: Openstack-System-Scope: None Sep 03 03:43:03.309456 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: User-Agent: python-novaclient Sep 03 03:43:03.309456 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Auth-Token: gAAAAABjEs1GgY7gAzU61CkKwB7qKd4wIqEJcmioh9XVB5pgThCUi71eoZJ026t7nlTWzACxLrlQMos5ahqp70Cx4rSF8owKwARkOgUON7mczBewalYbDPOfS09Gko_lLdfcNMYvsC6AO2YxVaVdA7RpPMNQCunl5iHeMzXj9GLNpibu7pHVjTw Sep 03 03:43:03.309456 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Domain-Id: None Sep 03 03:43:03.309456 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Domain-Name: None Sep 03 03:43:03.309456 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Identity-Status: Confirmed Sep 03 03:43:03.309456 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Is-Admin-Project: True Sep 03 03:43:03.309456 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Openstack-Nova-Api-Version: 2.92 Sep 03 03:43:03.309456 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Project-Domain-Id: default Sep 03 03:43:03.309456 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Project-Domain-Name: Default Sep 03 03:43:03.309456 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Project-Id: 1fa3555aedbc4a4eaa2e41bd6d2eeab3 Sep 03 03:43:03.309456 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Project-Name: admin Sep 03 03:43:03.309456 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Role: member,reader,admin Sep 03 03:43:03.309456 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Roles: member,reader,admin Sep 03 03:43:03.310927 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1fa3555aedbc4a4eaa2e41bd6d2eeab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1fa3555aedbc4a4eaa2e41bd6d2eeab3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1fa3555aedbc4a4eaa2e41bd6d2eeab3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1fa3555aedbc4a4eaa2e41bd6d2eeab3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:43:03.310927 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Tenant: admin Sep 03 03:43:03.310927 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Tenant-Id: 1fa3555aedbc4a4eaa2e41bd6d2eeab3 Sep 03 03:43:03.310927 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Tenant-Name: admin Sep 03 03:43:03.310927 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-User: admin Sep 03 03:43:03.310927 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-User-Domain-Id: default Sep 03 03:43:03.310927 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-User-Domain-Name: Default Sep 03 03:43:03.310927 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-User-Id: 5009c224905e4768b33c681c0f95b0f8 Sep 03 03:43:03.310927 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-User-Name: admin Sep 03 03:43:03.310927 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: method: > Sep 03 03:43:03.310927 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: exception: Flavor 84 could not be found. Sep 03 03:43:03.310927 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: action_args: {'id': '84'} Sep 03 03:43:03.310927 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:43:03.310927 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:43:03.313185 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 03 03:43:03.313185 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 03 03:43:03.313185 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 03 03:43:03.313185 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 03 03:43:03.313185 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 03:43:03.313185 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 03:43:03.313185 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 03 03:43:03.313185 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 03 03:43:03.313185 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 03 03:43:03.313185 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:43:03.313185 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 03 03:43:03.313185 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 03 03:43:03.313185 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 03 03:43:03.313185 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi Sep 03 03:43:03.313185 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:43:03.313185 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi Sep 03 03:43:03.313185 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:43:03.313185 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:43:03.313185 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:43:03.314631 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:43:03.314631 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:43:03.314631 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:43:03.314631 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:43:03.314631 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 03 03:43:03.314631 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:43:03.314631 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 03 03:43:03.314631 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi Sep 03 03:43:03.314631 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:43:03.314631 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi Sep 03 03:43:03.314631 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:43:03.314631 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:43:03.314631 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:43:03.314631 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:43:03.314631 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:43:03.314631 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 03 03:43:03.314631 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi Sep 03 03:43:03.314631 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-725d3f34-ecbd-475f-be88-cb67da6cfd0c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=117084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:43:03.315764 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.requestlog [None req-725d3f34-ecbd-475f-be88-cb67da6cfd0c admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011905 Sep 03 03:43:03.315764 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: [pid: 117084|app: 0|req: 23/47] 10.222.0.25 () {60 vars in 1190 bytes} [Sat Sep 3 03:43:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 03 03:43:04.299800 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-afad82eb-67c2-4684-9405-3aaff5a34401 admin admin] Calling method '>' {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:43:04.300809 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-afad82eb-67c2-4684-9405-3aaff5a34401 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001572 Sep 03 03:43:04.301208 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 25/48] 10.222.0.25 () {56 vars in 1074 bytes} [Sat Sep 3 03:43:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:43:04.861345 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-7f58ffe0-9b9e-4d97-9aa0-8e24a0de279f admin admin] Calling method '>' {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:43:04.867439 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.wsgi [None req-7f58ffe0-9b9e-4d97-9aa0-8e24a0de279f admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 03 03:43:04.868943 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-7f58ffe0-9b9e-4d97-9aa0-8e24a0de279f admin admin] Request method failure captured: Sep 03 03:43:04.868943 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 03 03:43:04.868943 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: Accept: application/json Sep 03 03:43:04.868943 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: Accept-Encoding: gzip, deflate Sep 03 03:43:04.868943 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: Connection: keep-alive Sep 03 03:43:04.868943 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: Content-Length: 0 Sep 03 03:43:04.868943 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: Host: 10.222.0.25 Sep 03 03:43:04.868943 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: Openstack-Api-Version: compute 2.92 Sep 03 03:43:04.868943 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: Openstack-System-Scope: None Sep 03 03:43:04.868943 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: User-Agent: python-novaclient Sep 03 03:43:04.868943 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Auth-Token: gAAAAABjEs1IFbUVfAc6JjFFDbE3lUKjj6E0Jm3-YVrypQGz64XixTj2_HYUTPHkPppoSsKPUag9XC9-8PZhswDArcJrzXuSkMos4UN-FcEOssB6viYKZD2FwgbeaoGGxRMmH7JG28hNwz6G6XqyhqP3knWJJo9kzK5vPHewruQC0OhP5IyAEnA Sep 03 03:43:04.868943 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Domain-Id: None Sep 03 03:43:04.868943 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Domain-Name: None Sep 03 03:43:04.868943 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Identity-Status: Confirmed Sep 03 03:43:04.868943 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Is-Admin-Project: True Sep 03 03:43:04.868943 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Openstack-Nova-Api-Version: 2.92 Sep 03 03:43:04.868943 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Project-Domain-Id: default Sep 03 03:43:04.868943 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Project-Domain-Name: Default Sep 03 03:43:04.868943 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Project-Id: 1fa3555aedbc4a4eaa2e41bd6d2eeab3 Sep 03 03:43:04.868943 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Project-Name: admin Sep 03 03:43:04.868943 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Role: member,reader,admin Sep 03 03:43:04.868943 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Roles: member,reader,admin Sep 03 03:43:04.870419 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1fa3555aedbc4a4eaa2e41bd6d2eeab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1fa3555aedbc4a4eaa2e41bd6d2eeab3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1fa3555aedbc4a4eaa2e41bd6d2eeab3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1fa3555aedbc4a4eaa2e41bd6d2eeab3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:43:04.870419 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Tenant: admin Sep 03 03:43:04.870419 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Tenant-Id: 1fa3555aedbc4a4eaa2e41bd6d2eeab3 Sep 03 03:43:04.870419 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-Tenant-Name: admin Sep 03 03:43:04.870419 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-User: admin Sep 03 03:43:04.870419 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-User-Domain-Id: default Sep 03 03:43:04.870419 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-User-Domain-Name: Default Sep 03 03:43:04.870419 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-User-Id: 5009c224905e4768b33c681c0f95b0f8 Sep 03 03:43:04.870419 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: X-User-Name: admin Sep 03 03:43:04.870419 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: method: > Sep 03 03:43:04.870419 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: exception: Flavor 451 could not be found. Sep 03 03:43:04.870419 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: action_args: {'id': '451'} Sep 03 03:43:04.870419 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:43:04.870419 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:43:04.871321 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 03 03:43:04.871321 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 03 03:43:04.871321 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 03 03:43:04.871321 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 03 03:43:04.871321 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 03:43:04.871321 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 03:43:04.871321 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 03 03:43:04.871321 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 03 03:43:04.871321 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 03 03:43:04.871321 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:43:04.871321 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 03 03:43:04.871321 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 03 03:43:04.871321 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 03 03:43:04.871321 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi Sep 03 03:43:04.871321 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:43:04.871321 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi Sep 03 03:43:04.871321 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:43:04.871321 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:43:04.871321 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:43:04.872350 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:43:04.872350 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:43:04.872350 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:43:04.872350 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:43:04.872350 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 03 03:43:04.872350 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:43:04.872350 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 03 03:43:04.872350 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi Sep 03 03:43:04.872350 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:43:04.872350 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi Sep 03 03:43:04.872350 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:43:04.872350 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:43:04.872350 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:43:04.872350 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:43:04.872350 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:43:04.872350 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 03 03:43:04.872350 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: ERROR nova.api.openstack.wsgi Sep 03 03:43:04.872350 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-7f58ffe0-9b9e-4d97-9aa0-8e24a0de279f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=117084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:43:04.873306 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.requestlog [None req-7f58ffe0-9b9e-4d97-9aa0-8e24a0de279f admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.431256 Sep 03 03:43:04.873306 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: [pid: 117084|app: 0|req: 24/49] 10.222.0.25 () {60 vars in 1193 bytes} [Sat Sep 3 03:43:04 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 433 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 03 03:43:04.880182 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-f65635f4-e516-424a-af74-6dad48db1a1d admin admin] Calling method '>' {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:43:04.895302 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-f65635f4-e516-424a-af74-6dad48db1a1d admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018712 Sep 03 03:43:04.895820 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 26/50] 10.222.0.25 () {60 vars in 1210 bytes} [Sat Sep 3 03:43:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:43:04.905292 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-38431822-49d9-45dc-ac77-a83f7ffb4e5f admin admin] Calling method '>' {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:43:04.921152 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.requestlog [None req-38431822-49d9-45dc-ac77-a83f7ffb4e5f admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019373 Sep 03 03:43:04.921830 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: [pid: 117084|app: 0|req: 25/51] 10.222.0.25 () {60 vars in 1210 bytes} [Sat Sep 3 03:43:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:43:04.931065 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-02c3b25c-5aac-4b53-b064-9402a824949c admin admin] Calling method '>' {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:43:04.936358 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.wsgi [None req-02c3b25c-5aac-4b53-b064-9402a824949c admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 03 03:43:04.937830 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-02c3b25c-5aac-4b53-b064-9402a824949c admin admin] Request method failure captured: Sep 03 03:43:04.937830 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 03 03:43:04.937830 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: Accept: application/json Sep 03 03:43:04.937830 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: Accept-Encoding: gzip, deflate Sep 03 03:43:04.937830 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: Connection: keep-alive Sep 03 03:43:04.937830 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: Content-Length: 0 Sep 03 03:43:04.937830 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: Host: 10.222.0.25 Sep 03 03:43:04.937830 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: Openstack-Api-Version: compute 2.92 Sep 03 03:43:04.937830 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: Openstack-System-Scope: None Sep 03 03:43:04.937830 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: User-Agent: python-novaclient Sep 03 03:43:04.937830 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Auth-Token: gAAAAABjEs1IFbUVfAc6JjFFDbE3lUKjj6E0Jm3-YVrypQGz64XixTj2_HYUTPHkPppoSsKPUag9XC9-8PZhswDArcJrzXuSkMos4UN-FcEOssB6viYKZD2FwgbeaoGGxRMmH7JG28hNwz6G6XqyhqP3knWJJo9kzK5vPHewruQC0OhP5IyAEnA Sep 03 03:43:04.937830 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Domain-Id: None Sep 03 03:43:04.937830 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Domain-Name: None Sep 03 03:43:04.937830 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Identity-Status: Confirmed Sep 03 03:43:04.937830 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Is-Admin-Project: True Sep 03 03:43:04.937830 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Openstack-Nova-Api-Version: 2.92 Sep 03 03:43:04.937830 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Project-Domain-Id: default Sep 03 03:43:04.937830 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Project-Domain-Name: Default Sep 03 03:43:04.937830 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Project-Id: 1fa3555aedbc4a4eaa2e41bd6d2eeab3 Sep 03 03:43:04.937830 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Project-Name: admin Sep 03 03:43:04.937830 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Role: member,reader,admin Sep 03 03:43:04.937830 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Roles: member,reader,admin Sep 03 03:43:04.939396 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1fa3555aedbc4a4eaa2e41bd6d2eeab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1fa3555aedbc4a4eaa2e41bd6d2eeab3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1fa3555aedbc4a4eaa2e41bd6d2eeab3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1fa3555aedbc4a4eaa2e41bd6d2eeab3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:43:04.939396 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Tenant: admin Sep 03 03:43:04.939396 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Tenant-Id: 1fa3555aedbc4a4eaa2e41bd6d2eeab3 Sep 03 03:43:04.939396 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-Tenant-Name: admin Sep 03 03:43:04.939396 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-User: admin Sep 03 03:43:04.939396 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-User-Domain-Id: default Sep 03 03:43:04.939396 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-User-Domain-Name: Default Sep 03 03:43:04.939396 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-User-Id: 5009c224905e4768b33c681c0f95b0f8 Sep 03 03:43:04.939396 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: X-User-Name: admin Sep 03 03:43:04.939396 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: method: > Sep 03 03:43:04.939396 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: exception: Flavor 451 could not be found. Sep 03 03:43:04.939396 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: action_args: {'id': '451'} Sep 03 03:43:04.939396 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:43:04.939396 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:43:04.940411 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 03 03:43:04.940411 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 03 03:43:04.940411 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 03 03:43:04.940411 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 03 03:43:04.940411 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 03:43:04.940411 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 03:43:04.940411 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 03 03:43:04.940411 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 03 03:43:04.940411 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 03 03:43:04.940411 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:43:04.940411 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 03 03:43:04.940411 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 03 03:43:04.940411 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 03 03:43:04.940411 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi Sep 03 03:43:04.940411 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:43:04.940411 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi Sep 03 03:43:04.940411 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:43:04.940411 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:43:04.940411 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:43:04.941442 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:43:04.941442 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:43:04.941442 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:43:04.941442 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:43:04.941442 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 03 03:43:04.941442 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:43:04.941442 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 03 03:43:04.941442 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi Sep 03 03:43:04.941442 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:43:04.941442 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi Sep 03 03:43:04.941442 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:43:04.941442 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:43:04.941442 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:43:04.941442 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:43:04.941442 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:43:04.941442 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 03 03:43:04.941442 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: ERROR nova.api.openstack.wsgi Sep 03 03:43:04.941442 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-02c3b25c-5aac-4b53-b064-9402a824949c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=117085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:43:04.942469 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-02c3b25c-5aac-4b53-b064-9402a824949c admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011560 Sep 03 03:43:04.942469 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 27/52] 10.222.0.25 () {60 vars in 1193 bytes} [Sat Sep 3 03:43:04 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 03 03:43:05.941525 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-38431822-49d9-45dc-ac77-a83f7ffb4e5f admin admin] Calling method '>' {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:43:05.942528 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.requestlog [None req-38431822-49d9-45dc-ac77-a83f7ffb4e5f admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Sep 03 03:43:05.942980 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: [pid: 117084|app: 0|req: 26/53] 10.222.0.25 () {56 vars in 1074 bytes} [Sat Sep 3 03:43:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 03:43:06.493281 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-0576c977-4f31-4b2a-a465-0c2daf5e971c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:43:06.514839 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-0576c977-4f31-4b2a-a465-0c2daf5e971c admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.436090 Sep 03 03:43:06.515452 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 28/54] 10.222.0.25 () {64 vars in 1235 bytes} [Sat Sep 3 03:43:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 03:43:07.492332 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-38431822-49d9-45dc-ac77-a83f7ffb4e5f admin admin] Calling method '>' {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:43:07.493342 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.requestlog [None req-38431822-49d9-45dc-ac77-a83f7ffb4e5f admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Sep 03 03:43:07.493757 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: [pid: 117084|app: 0|req: 27/55] 10.222.0.25 () {56 vars in 1074 bytes} [Sat Sep 3 03:43:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:43:08.031912 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-c3a9d128-4bf8-42e6-8d0b-c940795224f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:43:08.052625 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-c3a9d128-4bf8-42e6-8d0b-c940795224f9 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.421091 Sep 03 03:43:08.053098 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 29/56] 10.222.0.25 () {64 vars in 1235 bytes} [Sat Sep 3 03:43:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 03:43:09.049201 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-38431822-49d9-45dc-ac77-a83f7ffb4e5f admin admin] Calling method '>' {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:43:09.050350 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.requestlog [None req-38431822-49d9-45dc-ac77-a83f7ffb4e5f admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002026 Sep 03 03:43:09.050745 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: [pid: 117084|app: 0|req: 28/57] 10.222.0.25 () {56 vars in 1074 bytes} [Sat Sep 3 03:43:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:43:09.618036 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-d1f6dc97-8abd-463e-9f62-198cc3b98737 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:43:09.647745 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-d1f6dc97-8abd-463e-9f62-198cc3b98737 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.460325 Sep 03 03:43:09.648287 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 30/58] 10.222.0.25 () {64 vars in 1235 bytes} [Sat Sep 3 03:43:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 03:43:10.633467 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-38431822-49d9-45dc-ac77-a83f7ffb4e5f admin admin] Calling method '>' {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:43:10.634797 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.requestlog [None req-38431822-49d9-45dc-ac77-a83f7ffb4e5f admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002014 Sep 03 03:43:10.635443 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: [pid: 117084|app: 0|req: 29/59] 10.222.0.25 () {56 vars in 1074 bytes} [Sat Sep 3 03:43:10 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:43:11.182642 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-02dafbb9-d6cd-4ed8-bff8-45a724d492a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:43:11.209821 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-02dafbb9-d6cd-4ed8-bff8-45a724d492a3 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.429708 Sep 03 03:43:11.210376 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 31/60] 10.222.0.25 () {64 vars in 1235 bytes} [Sat Sep 3 03:43:10 2022] POST /compute/v2.1/flavors => generated 409 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 03:43:12.182007 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-38431822-49d9-45dc-ac77-a83f7ffb4e5f admin admin] Calling method '>' {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:43:12.183133 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.requestlog [None req-38431822-49d9-45dc-ac77-a83f7ffb4e5f admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Sep 03 03:43:12.183523 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: [pid: 117084|app: 0|req: 30/61] 10.222.0.25 () {56 vars in 1074 bytes} [Sat Sep 3 03:43:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:43:12.765092 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-ebd21897-9068-4813-bda0-99295e455ab1 admin admin] Calling method '>' {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:43:12.785799 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-ebd21897-9068-4813-bda0-99295e455ab1 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.466253 Sep 03 03:43:12.786275 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 32/62] 10.222.0.25 () {60 vars in 1202 bytes} [Sat Sep 3 03:43:12 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:44:06.168598 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-38431822-49d9-45dc-ac77-a83f7ffb4e5f admin admin] Calling method '>' {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:44:06.169465 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.requestlog [None req-38431822-49d9-45dc-ac77-a83f7ffb4e5f admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Sep 03 03:44:06.169860 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: [pid: 117084|app: 0|req: 31/63] 10.222.0.25 () {54 vars in 931 bytes} [Sat Sep 3 03:44:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 03:44:06.180464 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG dbcounter [-] [117085] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=117085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:44:06.572104 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-34eb84a2-b025-4f07-9324-7b6c4cdbfd21 admin admin] Calling method '>' {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:44:06.592842 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-34eb84a2-b025-4f07-9324-7b6c4cdbfd21 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.416848 Sep 03 03:44:06.593371 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 33/64] 10.222.0.25 () {60 vars in 1292 bytes} [Sat Sep 3 03:44:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 03:44:06.614436 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG dbcounter [-] [117084] Writing DB stats nova_api:SELECT=14 {{(pid=117084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:44:06.618185 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-7d6c3c73-0626-48a5-8538-f9d963347c60 admin admin] Calling method '>' {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:44:06.626386 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.requestlog [None req-7d6c3c73-0626-48a5-8538-f9d963347c60 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013506 Sep 03 03:44:06.626932 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: [pid: 117084|app: 0|req: 32/65] 10.222.0.25 () {60 vars in 1283 bytes} [Sat Sep 3 03:44:06 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:44:06.638616 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-5f3d8494-f138-4f36-9acb-df94ffb306a9 admin admin] Calling method '>' {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:44:06.646953 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-5f3d8494-f138-4f36-9acb-df94ffb306a9 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011908 Sep 03 03:44:06.647518 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 34/66] 10.222.0.25 () {60 vars in 1286 bytes} [Sat Sep 3 03:44:06 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:44:06.658904 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-d7493e37-ed77-45cf-aadd-5e5ffc46a63f admin admin] Calling method '>' {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:44:06.666586 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.requestlog [None req-d7493e37-ed77-45cf-aadd-5e5ffc46a63f admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011231 Sep 03 03:44:06.667143 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: [pid: 117084|app: 0|req: 33/67] 10.222.0.25 () {60 vars in 1286 bytes} [Sat Sep 3 03:44:06 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:44:06.678369 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-b35d0ed3-1387-494d-b69b-a707b5ea5366 admin admin] Calling method '>' {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:44:06.685955 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-b35d0ed3-1387-494d-b69b-a707b5ea5366 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011124 Sep 03 03:44:06.686473 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 35/68] 10.222.0.25 () {60 vars in 1283 bytes} [Sat Sep 3 03:44:06 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:47:04.296924 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-d7493e37-ed77-45cf-aadd-5e5ffc46a63f admin admin] Calling method '>' {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:47:04.298062 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.requestlog [None req-d7493e37-ed77-45cf-aadd-5e5ffc46a63f admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Sep 03 03:47:04.298445 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: [pid: 117084|app: 0|req: 34/69] 10.222.0.25 () {56 vars in 1074 bytes} [Sat Sep 3 03:47:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:47:04.439745 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG dbcounter [-] [117085] Writing DB stats nova_api:SELECT=6 {{(pid=117085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:47:04.604082 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-003a93eb-c9bf-458e-a3de-c118b646478b admin admin] Calling method '>' {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:47:04.607919 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG oslo_concurrency.lockutils [None req-003a93eb-c9bf-458e-a3de-c118b646478b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:47:04.608387 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG oslo_concurrency.lockutils [None req-003a93eb-c9bf-458e-a3de-c118b646478b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:47:04.608806 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG oslo_concurrency.lockutils [None req-003a93eb-c9bf-458e-a3de-c118b646478b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:47:04.609510 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG oslo_concurrency.lockutils [None req-003a93eb-c9bf-458e-a3de-c118b646478b admin admin] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:47:04.609944 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG oslo_concurrency.lockutils [None req-003a93eb-c9bf-458e-a3de-c118b646478b admin admin] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:47:04.610351 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG oslo_concurrency.lockutils [None req-003a93eb-c9bf-458e-a3de-c118b646478b admin admin] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:47:04.644218 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-003a93eb-c9bf-458e-a3de-c118b646478b admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.206831 Sep 03 03:47:04.644781 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 36/70] 10.222.0.25 () {60 vars in 1193 bytes} [Sat Sep 3 03:47:04 2022] GET /compute/v2.1/os-services => generated 794 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 03:47:05.485162 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-d7493e37-ed77-45cf-aadd-5e5ffc46a63f admin admin] Calling method '>' {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:47:05.486174 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.requestlog [None req-d7493e37-ed77-45cf-aadd-5e5ffc46a63f admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Sep 03 03:47:05.486563 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: [pid: 117084|app: 0|req: 35/71] 10.222.0.25 () {56 vars in 1074 bytes} [Sat Sep 3 03:47:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:47:05.690382 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-36b48df4-1ac0-4644-a6bb-8ce851fb3343 admin admin] Calling method '>' {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:47:05.693811 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG oslo_concurrency.lockutils [None req-36b48df4-1ac0-4644-a6bb-8ce851fb3343 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:47:05.694284 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG oslo_concurrency.lockutils [None req-36b48df4-1ac0-4644-a6bb-8ce851fb3343 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:47:05.694706 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG oslo_concurrency.lockutils [None req-36b48df4-1ac0-4644-a6bb-8ce851fb3343 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:47:05.695449 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG oslo_concurrency.lockutils [None req-36b48df4-1ac0-4644-a6bb-8ce851fb3343 admin admin] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:47:05.695882 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG oslo_concurrency.lockutils [None req-36b48df4-1ac0-4644-a6bb-8ce851fb3343 admin admin] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:47:05.696291 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG oslo_concurrency.lockutils [None req-36b48df4-1ac0-4644-a6bb-8ce851fb3343 admin admin] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:47:05.716446 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-36b48df4-1ac0-4644-a6bb-8ce851fb3343 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.085430 Sep 03 03:47:05.716962 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 37/72] 10.222.0.25 () {60 vars in 1193 bytes} [Sat Sep 3 03:47:05 2022] GET /compute/v2.1/os-services => generated 794 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 03:47:16.983213 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-d7493e37-ed77-45cf-aadd-5e5ffc46a63f admin admin] Calling method '>' {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:47:16.984240 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.requestlog [None req-d7493e37-ed77-45cf-aadd-5e5ffc46a63f admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Sep 03 03:47:16.984635 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: [pid: 117084|app: 0|req: 36/73] 10.222.0.25 () {56 vars in 1074 bytes} [Sat Sep 3 03:47:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:47:17.124802 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG dbcounter [-] [117085] Writing DB stats nova_cell0:SELECT=4 {{(pid=117085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:47:17.125518 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG dbcounter [-] [117085] Writing DB stats nova_cell1:SELECT=4 {{(pid=117085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:47:17.126097 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG dbcounter [-] [117085] Writing DB stats nova_api:SELECT=8 {{(pid=117085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:47:17.176010 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-6a0d3833-d77b-4bd9-a1e3-ae738040e477 admin admin] Calling method '>' {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:47:17.179421 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG oslo_concurrency.lockutils [None req-6a0d3833-d77b-4bd9-a1e3-ae738040e477 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:47:17.179893 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG oslo_concurrency.lockutils [None req-6a0d3833-d77b-4bd9-a1e3-ae738040e477 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:47:17.180383 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG oslo_concurrency.lockutils [None req-6a0d3833-d77b-4bd9-a1e3-ae738040e477 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:47:17.181569 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG oslo_concurrency.lockutils [None req-6a0d3833-d77b-4bd9-a1e3-ae738040e477 admin admin] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:47:17.181995 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG oslo_concurrency.lockutils [None req-6a0d3833-d77b-4bd9-a1e3-ae738040e477 admin admin] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:47:17.182409 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG oslo_concurrency.lockutils [None req-6a0d3833-d77b-4bd9-a1e3-ae738040e477 admin admin] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:47:17.207373 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-6a0d3833-d77b-4bd9-a1e3-ae738040e477 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.087044 Sep 03 03:47:17.207926 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 38/74] 10.222.0.25 () {60 vars in 1193 bytes} [Sat Sep 3 03:47:17 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:47:18.036933 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: DEBUG nova.api.openstack.wsgi [None req-d7493e37-ed77-45cf-aadd-5e5ffc46a63f admin admin] Calling method '>' {{(pid=117084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:47:18.037941 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: INFO nova.api.openstack.requestlog [None req-d7493e37-ed77-45cf-aadd-5e5ffc46a63f admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Sep 03 03:47:18.038336 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: [pid: 117084|app: 0|req: 37/75] 10.222.0.25 () {56 vars in 1074 bytes} [Sat Sep 3 03:47:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:47:18.241506 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG nova.api.openstack.wsgi [None req-f06c1160-8c42-41ed-bef9-abcd3efaf64f admin admin] Calling method '>' {{(pid=117085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:47:18.244969 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG oslo_concurrency.lockutils [None req-f06c1160-8c42-41ed-bef9-abcd3efaf64f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:47:18.245443 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG oslo_concurrency.lockutils [None req-f06c1160-8c42-41ed-bef9-abcd3efaf64f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:47:18.245869 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG oslo_concurrency.lockutils [None req-f06c1160-8c42-41ed-bef9-abcd3efaf64f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:47:18.246581 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG oslo_concurrency.lockutils [None req-f06c1160-8c42-41ed-bef9-abcd3efaf64f admin admin] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:47:18.247051 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG oslo_concurrency.lockutils [None req-f06c1160-8c42-41ed-bef9-abcd3efaf64f admin admin] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:47:18.247466 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: DEBUG oslo_concurrency.lockutils [None req-f06c1160-8c42-41ed-bef9-abcd3efaf64f admin admin] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:47:18.269201 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: INFO nova.api.openstack.requestlog [None req-f06c1160-8c42-41ed-bef9-abcd3efaf64f admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.093341 Sep 03 03:47:18.269773 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: [pid: 117085|app: 0|req: 39/76] 10.222.0.25 () {60 vars in 1193 bytes} [Sat Sep 3 03:47:18 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:48:13.993208 dv-cinder-799663-12-iscsi devstack@n-api.service[117083]: Sat Sep 3 03:48:13 2022 - graceful shutdown triggered... Sep 03 03:48:13.993294 dv-cinder-799663-12-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 03 03:48:13.994173 dv-cinder-799663-12-iscsi devstack@n-api.service[117084]: Gracefully killing worker 1 (pid: 117084)... Sep 03 03:48:13.994545 dv-cinder-799663-12-iscsi devstack@n-api.service[117085]: Gracefully killing worker 2 (pid: 117085)... Sep 03 03:48:14.995067 dv-cinder-799663-12-iscsi devstack@n-api.service[117083]: worker 1 buried after 1 seconds Sep 03 03:48:14.995067 dv-cinder-799663-12-iscsi devstack@n-api.service[117083]: worker 2 buried after 1 seconds Sep 03 03:48:14.995067 dv-cinder-799663-12-iscsi devstack@n-api.service[117083]: goodbye to uWSGI. Sep 03 03:48:14.997683 dv-cinder-799663-12-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 03 03:48:14.998605 dv-cinder-799663-12-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 03 03:48:15.003211 dv-cinder-799663-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 03 03:48:15.013099 dv-cinder-799663-12-iscsi devstack@n-api.service[132063]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 03 03:48:15.015833 dv-cinder-799663-12-iscsi devstack@n-api.service[132063]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 3 03:48:15 2022] *** Sep 03 03:48:15.015999 dv-cinder-799663-12-iscsi devstack@n-api.service[132063]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 03 03:48:15.016111 dv-cinder-799663-12-iscsi devstack@n-api.service[132063]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 03 03:48:15.016230 dv-cinder-799663-12-iscsi devstack@n-api.service[132063]: nodename: dv-cinder-799663-12-iscsi Sep 03 03:48:15.016337 dv-cinder-799663-12-iscsi devstack@n-api.service[132063]: machine: x86_64 Sep 03 03:48:15.016444 dv-cinder-799663-12-iscsi devstack@n-api.service[132063]: clock source: unix Sep 03 03:48:15.016549 dv-cinder-799663-12-iscsi devstack@n-api.service[132063]: pcre jit disabled Sep 03 03:48:15.016661 dv-cinder-799663-12-iscsi devstack@n-api.service[132063]: detected number of CPU cores: 4 Sep 03 03:48:15.016770 dv-cinder-799663-12-iscsi devstack@n-api.service[132063]: current working directory: / Sep 03 03:48:15.016884 dv-cinder-799663-12-iscsi devstack@n-api.service[132063]: detected binary path: /usr/bin/uwsgi-core Sep 03 03:48:15.017008 dv-cinder-799663-12-iscsi devstack@n-api.service[132063]: your processes number limit is 47680 Sep 03 03:48:15.017119 dv-cinder-799663-12-iscsi devstack@n-api.service[132063]: your memory page size is 4096 bytes Sep 03 03:48:15.017226 dv-cinder-799663-12-iscsi devstack@n-api.service[132063]: detected max file descriptor number: 2048 Sep 03 03:48:15.017382 dv-cinder-799663-12-iscsi devstack@n-api.service[132063]: lock engine: pthread robust mutexes Sep 03 03:48:15.017543 dv-cinder-799663-12-iscsi devstack@n-api.service[132063]: thunder lock: enabled Sep 03 03:48:15.017727 dv-cinder-799663-12-iscsi devstack@n-api.service[132063]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 03 03:48:15.017948 dv-cinder-799663-12-iscsi devstack@n-api.service[132063]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 03 03:48:15.056491 dv-cinder-799663-12-iscsi devstack@n-api.service[132063]: Python main interpreter initialized at 0x55fd113ff9c0 Sep 03 03:48:15.056491 dv-cinder-799663-12-iscsi devstack@n-api.service[132063]: python threads support enabled Sep 03 03:48:15.056491 dv-cinder-799663-12-iscsi devstack@n-api.service[132063]: your server socket listen backlog is limited to 100 connections Sep 03 03:48:15.056491 dv-cinder-799663-12-iscsi devstack@n-api.service[132063]: your mercy for graceful operations on workers is 90 seconds Sep 03 03:48:15.056972 dv-cinder-799663-12-iscsi devstack@n-api.service[132063]: mapped 403077 bytes (393 KB) for 2 cores Sep 03 03:48:15.056972 dv-cinder-799663-12-iscsi devstack@n-api.service[132063]: *** Operational MODE: preforking *** Sep 03 03:48:15.057185 dv-cinder-799663-12-iscsi devstack@n-api.service[132063]: *** uWSGI is running in multiple interpreter mode *** Sep 03 03:48:15.057185 dv-cinder-799663-12-iscsi devstack@n-api.service[132063]: spawned uWSGI master process (pid: 132063) Sep 03 03:48:15.057426 dv-cinder-799663-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 03 03:48:15.058791 dv-cinder-799663-12-iscsi devstack@n-api.service[132063]: spawned uWSGI worker 1 (pid: 132076, cores: 1) Sep 03 03:48:15.058791 dv-cinder-799663-12-iscsi devstack@n-api.service[132063]: spawned uWSGI worker 2 (pid: 132077, cores: 1) Sep 03 03:48:15.058791 dv-cinder-799663-12-iscsi devstack@n-api.service[132063]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 03 03:48:15.708897 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 03 03:48:15.710744 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 03 03:48:16.856523 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 03:48:16.856523 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: from cryptography.utils import int_from_bytes Sep 03 03:48:16.857637 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 03:48:16.857637 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: from cryptography.utils import int_from_bytes Sep 03 03:48:16.869377 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 03:48:16.869377 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: from cryptography.utils import int_from_bytes Sep 03 03:48:16.870007 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 03:48:16.870007 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: from cryptography.utils import int_from_bytes Sep 03 03:48:19.250251 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 03 03:48:19.251157 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 03 03:48:19.251895 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 03 03:48:19.252423 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 03 03:48:19.252826 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 03 03:48:19.253382 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.253881 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.254434 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.254935 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.255429 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.255901 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.256397 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.256873 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.257367 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.257799 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.258521 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.258760 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799663-12-iscsi {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.259259 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.259739 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.260210 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.260694 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.261146 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.261631 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.262092 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.262854 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.264768 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.265299 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.265805 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.266411 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.266979 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.267496 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.268033 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.268565 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.269048 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.269371 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.269878 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799663-12-iscsi {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.270202 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.270557 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.270898 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.271332 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.271688 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.272005 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.272327 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.272654 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.272961 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.273293 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.273615 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.273935 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.274303 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.274642 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.274981 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.275302 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.275647 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.275953 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.276215 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.276470 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.276777 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.277129 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.277449 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.277776 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.278018 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.278268 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.278584 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.278911 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.279218 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.279508 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.279820 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.280117 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.280420 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.280695 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 03 03:48:19.281151 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.281268 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 03 03:48:19.281355 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.281355 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.281500 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 03 03:48:19.281594 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.281843 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 03 03:48:19.282100 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 03 03:48:19.282435 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.282560 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.282760 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.282931 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.283138 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.283250 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.283458 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.283570 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.283792 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.283917 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.284101 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.284222 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.284414 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.284525 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.284765 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.284908 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.285059 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.285215 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.285438 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.285764 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.286010 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.286151 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.286320 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.286437 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.286670 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.287012 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.287248 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799663-12-iscsi {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.287362 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.287591 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.287707 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.287936 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.288048 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.288153 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.288270 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.288546 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.288719 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.288854 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.289184 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.289461 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.289591 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.289995 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.290133 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.290311 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.290485 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.290640 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.290875 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.291041 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.291188 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.291340 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.291490 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.291643 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.291798 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.291978 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.292154 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.292301 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.292451 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.292615 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.292769 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.292915 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.293066 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.293218 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.293372 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.293525 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.293674 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799663-12-iscsi {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.293826 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.293976 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.294132 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.294290 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.294454 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.294616 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.294767 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.294767 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.295092 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.295247 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.295473 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.295647 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.295815 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.296507 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.296672 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.296824 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.297000 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.297155 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.297393 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.297560 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.297801 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.297993 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.298184 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.301045 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.301236 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.301413 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.302125 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.302300 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.302452 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.302615 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.302783 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.302987 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.303140 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.303295 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.303442 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.303595 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.303751 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.303906 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.304059 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.304211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.304362 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.304528 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.304675 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.305089 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.305238 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.305390 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.305547 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.305701 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.305846 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.306074 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.306714 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.306921 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.307169 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.307560 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.307724 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.307976 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.308174 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.308345 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.308492 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.308644 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.308796 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.308947 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.309092 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.309249 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.309401 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.309542 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.309664 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.309834 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.309987 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.310146 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.310374 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.310519 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.310746 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.310947 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.311093 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.311287 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.311441 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.311591 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.311745 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.311908 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.312109 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.312270 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.312416 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.312566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.312566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.312856 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.313016 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.313160 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.313317 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.313470 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.313613 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.313756 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.313924 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.314078 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.314227 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.314370 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.314511 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.314667 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.314862 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.314862 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.315154 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.315305 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.315305 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.315305 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.315744 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.315908 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.316060 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.316204 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.316909 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.317082 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.317239 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.317393 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.317721 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.317881 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.318135 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.318300 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.318447 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.318590 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.318752 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.318973 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.319138 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.319292 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.319437 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.319588 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.319911 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.320064 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.320223 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.320377 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.320522 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.320674 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.320827 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.320982 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.321136 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.321289 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.321484 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.321631 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.321631 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.321912 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.322066 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.322227 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.322382 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.322534 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.322685 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.322867 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.323033 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.323180 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.323331 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.323483 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.323634 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.323787 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.323931 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.324074 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.324216 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.324360 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.324503 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.324659 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.324814 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.324956 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.325110 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.325262 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.325407 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.325559 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.325704 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.325846 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.326001 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.326157 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.326300 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.326733 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.327214 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.327382 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.327542 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.327785 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.327962 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.328283 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.328442 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.328589 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.328742 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.328901 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.329048 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.329198 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.329352 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.329503 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.329660 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.329814 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.329958 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.330101 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.330244 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.330386 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.330528 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.330758 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.330927 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.331086 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.331231 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.331385 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.331583 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.331757 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.331909 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.332065 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.332247 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.332393 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.332551 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.332704 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.332849 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.332992 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.333143 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.333296 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.333449 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.333604 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.333757 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.333902 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.334054 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.334197 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.334354 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.334498 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.334647 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.334793 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.334961 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.335117 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.335264 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.335415 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:48:19.335577 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.335577 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.335881 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.336043 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.336196 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.336348 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.336500 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.336752 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.337260 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.337429 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.337584 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.337744 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.337977 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.338129 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.338457 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.338617 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.338770 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.338974 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.339120 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.339274 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.339428 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.339574 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.339724 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.339870 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.340014 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.340170 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.340327 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.340482 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.340635 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.340780 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.340923 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.341073 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.341226 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.341377 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.341522 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.341715 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.341870 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.342025 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.342025 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.342342 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.342487 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.342638 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.342781 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.343061 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.343219 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.343364 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.343514 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.343674 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.343817 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.343973 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.344117 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.344279 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.344431 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.344587 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.344741 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.344895 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.345057 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.345210 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.345362 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.345506 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.345659 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.345813 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.345957 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.346110 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.346261 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.346406 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.346558 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.346850 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.347386 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.347551 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.347896 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.348147 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.348340 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.348648 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.348807 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.348960 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.349127 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.349273 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.349425 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.349580 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.349739 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.349885 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.350038 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.350198 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.350344 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.350495 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.350649 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.350817 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.350968 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.351218 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.351382 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.351530 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.351717 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.351717 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.352011 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.352173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.352320 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.352471 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.352617 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.352759 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.352909 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.353063 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.353217 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.353217 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.353504 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.353649 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.353790 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.353942 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.354086 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.354229 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.354371 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.354514 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.354671 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.354857 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.355008 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.355178 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.355323 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.355472 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.355629 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.355629 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.355911 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.355911 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.356201 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.356201 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.356483 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.357045 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.357554 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.357726 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.357874 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.358025 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.358264 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.358415 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.358579 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.358889 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.359056 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.359216 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.359361 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.359511 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.359656 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.359799 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.360098 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.360264 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.360418 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.360563 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.361316 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.362144 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.362309 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.362471 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.362919 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.363180 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.363340 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.363558 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.363759 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.363925 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.364089 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.364257 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.364417 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.364568 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.364718 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.364875 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.365033 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.365199 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.365351 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.365500 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.365662 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.365820 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.365972 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.366135 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.366287 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.366436 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.366586 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.366745 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.366936 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.367194 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.368437 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.368601 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.368753 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.369029 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.369320 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.369485 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.369638 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.369795 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.369954 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.370105 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.370269 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.370433 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.370592 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.370754 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.370974 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.371127 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.371309 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.371462 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.371613 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.371771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.372530 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.372695 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.372848 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.373000 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.373151 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.373309 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.373460 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.373626 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.373792 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.373943 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.374350 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.374516 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.374669 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.374850 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.375008 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.375158 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.375306 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.375627 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.375786 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.375953 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.376105 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.376259 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.376359 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.376448 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.376593 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.376737 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.376846 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.376942 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.376942 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.377117 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.377238 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.377371 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.377478 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.377779 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.377877 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.377951 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.378050 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.378146 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.378254 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.378527 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.378635 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.378732 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.378865 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.378957 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.379177 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.379298 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.379433 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.379536 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.379536 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.379703 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.379798 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.379885 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.379971 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.380067 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.380154 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.380238 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.380323 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.380408 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.380500 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.380602 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.380699 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.380793 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.380881 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.380978 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.381065 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.381156 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.381242 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.381334 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.381434 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.381529 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.381624 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.381717 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.381805 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.381917 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.382019 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.382107 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.382196 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.382338 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.382430 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.382524 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.382620 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.382707 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.382818 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.382908 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.382994 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.383079 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.383181 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.383269 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.383354 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.383438 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.383546 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.383644 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.383732 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.383824 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.383917 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.384005 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.384097 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.384196 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.384291 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.384385 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.384472 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.384556 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.384556 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.384737 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.384831 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.384935 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.385070 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.385159 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.385258 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.385346 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.385438 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.385679 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.385784 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.385872 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.385872 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.386045 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.386120 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.386214 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.386309 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.386395 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.386494 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.386588 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.386682 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.386867 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.386974 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.387070 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.387166 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.387254 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.387340 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.387476 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.387574 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.387670 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.387910 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.388016 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.388105 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.388190 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.388275 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.388368 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.388486 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.388720 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.388816 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.388903 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.388903 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.389079 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.389166 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.389251 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.389387 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.389482 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.389617 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.389799 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.389896 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.389983 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.390068 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.390152 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.390246 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.390333 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.390428 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.390515 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.390608 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.390701 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.390819 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.390922 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.391016 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.391103 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.391188 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.391281 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.391381 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.391475 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.391568 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.391663 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.391754 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.391840 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.391939 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.392028 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.392101 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.392190 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.392275 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.392373 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.392468 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.392554 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.392639 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.392726 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.392810 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.392909 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.392995 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.393089 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.393185 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.393278 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.393364 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.393457 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.393544 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.393544 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.393715 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.393800 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.393892 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.394061 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.394149 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.394234 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.394344 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.394433 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.394528 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.394615 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.394725 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.394926 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.395020 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.395106 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.395211 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.395308 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.395397 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.395482 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.395482 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.395743 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.395858 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.395949 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.396042 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.396135 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.396229 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.396357 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.396502 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.396617 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.396729 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.396854 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.396968 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.397087 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.397201 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.397328 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.397440 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.397561 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.397675 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.397795 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.398046 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.398212 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.398339 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.398462 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.398575 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.398848 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.398982 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.399098 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.399223 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.399376 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.399495 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.399607 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.399725 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.399837 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.399957 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.400077 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.400197 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.400339 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.400456 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.400576 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.400698 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.400817 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.400955 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.401183 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.401326 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.401474 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.401474 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.401699 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.401859 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.401975 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.402093 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.402216 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.402216 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.402470 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.402470 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.402649 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.402736 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.402881 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.402985 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.403082 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.403169 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.403253 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.403345 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.403440 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.403595 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.403595 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.403595 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.403843 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.403937 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.404032 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.404119 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.404205 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.404290 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.404374 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.404374 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.404547 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.404639 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.404726 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.404810 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.404903 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.405002 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.405088 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.405182 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.405269 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.405355 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.405446 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.405540 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.405633 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.405727 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.405815 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.405907 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.406001 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.406102 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.406189 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.406273 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.406364 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.406456 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.406542 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.406634 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.406727 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.406828 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.406916 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.407013 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.407109 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.407198 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.407282 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.407366 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.407460 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.407552 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.407652 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.407745 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.407831 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.407831 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.408211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.408324 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.408429 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.408526 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.408526 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.408526 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.408526 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.409054 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.409163 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.409262 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.409351 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.409443 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.409529 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.409624 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.409712 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.409797 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.409882 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.409967 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.410060 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.410155 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.410272 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.410387 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.410482 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.410597 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.410739 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.410941 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.411047 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.411258 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.411352 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.411560 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.411655 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.411865 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.411960 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.412201 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.412340 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.412493 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.412601 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.412793 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.412895 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.413094 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.413187 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.413392 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.413499 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.413692 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.413787 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.413993 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.414088 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.414295 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.414472 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.414593 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.414722 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.414909 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.415059 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.415211 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.415369 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.415510 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.415781 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.415876 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.416093 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.416201 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.416401 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.416509 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.416701 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.416803 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.416999 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.417109 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.417298 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.417393 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.417641 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.417735 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.417942 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.418049 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.418258 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.418363 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.418582 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.418685 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.419569 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.419698 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.419698 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.419870 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.419955 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.420049 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.420145 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.420243 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.420337 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.420424 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.420424 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.420595 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.420723 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.420877 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.421034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.421138 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.421355 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.421457 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.421662 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.421765 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.421965 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.422067 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.422290 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.422438 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.422584 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.422685 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.422909 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.423009 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.423235 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.423349 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.423556 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.423653 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.423878 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.423982 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.424180 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.424288 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.424487 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.424590 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.424793 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.424894 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.425098 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.425205 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.425402 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.425494 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.425706 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.425806 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.426033 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.426142 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.426336 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.426439 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.426644 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.426737 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.426971 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.427068 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.427279 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.427373 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.427585 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.427680 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.427894 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.427998 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.428200 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.428367 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.428501 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.428827 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.428962 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.429144 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.429304 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.429447 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.429627 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.429776 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.429926 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.430029 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.430230 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.430337 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.430535 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.430630 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.430907 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.431072 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.431215 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.431387 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.431536 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.431699 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.431870 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.432002 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.432205 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.432309 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.432513 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.432660 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.432848 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.432943 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.433177 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.433281 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.433496 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.433590 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.433803 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.433904 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.434123 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.434227 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.434449 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.434555 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.434752 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.434862 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.435082 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.435194 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.435399 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.435501 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.435700 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.435795 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.436011 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.436157 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.436314 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.436428 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.436612 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.436713 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.436911 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.437005 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.437212 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.437307 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.437510 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.437606 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.437829 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.437924 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.438128 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.438250 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.438459 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.438574 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.438753 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.438885 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.439097 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.439277 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.439400 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.439588 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.439692 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.439895 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.440035 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.440221 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.440340 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.440543 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.440669 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.440870 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.440967 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.441173 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.441293 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.441487 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.441666 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.441877 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.441972 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.442206 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.442301 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.442530 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.442678 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.442861 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.442961 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.443177 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.443291 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.443484 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.443602 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.443806 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.443914 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.444120 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.444241 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.444433 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.444528 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.444746 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.444839 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.445160 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.445312 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.445483 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.445641 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.445792 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.445954 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.446112 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.446270 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.446439 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.446582 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.446745 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.446944 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.447073 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.447258 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.447385 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.447571 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.447688 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.447888 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.447992 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.448198 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.448293 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.448513 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.448628 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.448841 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.448945 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.449162 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.449258 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.449479 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.449592 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.449781 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.449898 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.450083 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.450208 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.450402 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.450503 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.450704 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.450823 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.451045 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.451166 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.451355 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.451587 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.451755 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.451924 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.452066 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.452207 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.452347 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.452528 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.452698 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.452837 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.452986 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.453139 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.453290 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.453440 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.453607 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.453745 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.453837 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.453923 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.454054 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.454159 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.454353 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.454446 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.454657 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.454752 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.455005 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.455115 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.455317 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.455414 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.455628 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.455722 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.455962 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.456058 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.456280 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.456380 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.456590 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.456693 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.456896 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.456990 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.457233 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.457331 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.457554 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.457759 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.457868 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.458070 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.458173 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.458401 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.458497 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.458723 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.458873 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.459056 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.459165 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.459353 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.459457 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.459661 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.459765 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.459964 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.460076 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.460351 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.460452 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.460672 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.460784 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.460875 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.460950 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.461149 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.461247 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.461472 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.461583 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.461774 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.461876 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.462074 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.462183 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.462374 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.462469 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.462675 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.462853 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.463055 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.463212 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.463334 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.463544 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.463663 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.463904 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.464007 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.464220 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.464316 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.464551 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.464645 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.464880 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.464977 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.465190 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.465294 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.465495 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.465597 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.465808 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.465917 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.466116 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.466220 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.466420 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.466522 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.466726 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.466861 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.467063 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.467157 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.467368 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.467470 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.467675 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.467783 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.467986 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.468216 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.468321 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.468548 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.468650 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.468864 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.468963 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.469164 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.469257 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.469482 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.469589 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.469783 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.469880 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.470086 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.470189 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.470388 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.470498 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.470696 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.470791 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.471020 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.471118 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.471327 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.471461 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.471628 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.471732 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.471926 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.472038 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.472232 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.472343 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.472535 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.472645 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.472988 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.473118 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.473291 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.473395 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.473600 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.473703 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.473910 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.474019 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.474252 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.474374 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.474555 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.474658 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.474898 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.475014 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.475205 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.475308 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.475505 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.475600 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.475816 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.475918 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.476125 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.476218 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.476431 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.476522 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.476742 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.476850 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.477050 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.477149 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.477356 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.477450 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.477664 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.477772 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.477976 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.478226 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.478322 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.478568 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.478671 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.478993 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.479099 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.479330 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.479423 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.479642 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.479767 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.479951 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.480061 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.480252 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.480348 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.480555 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.480771 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.480868 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.481083 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.481177 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.481416 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.481515 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.482101 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.482206 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.482411 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.482518 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.482715 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.482841 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.483051 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.483157 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.483365 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.483535 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.483698 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.483861 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.484082 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.484229 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.484383 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.484525 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.484676 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.484826 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.484969 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.485110 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.485110 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.485386 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.485556 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.485714 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.485714 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.485934 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.486021 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.486114 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.486310 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.486414 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.486648 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.486864 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.486981 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.487215 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.487338 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.487528 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.487631 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.487854 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.487966 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.488176 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.488280 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.488506 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.488618 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.488808 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.488977 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.489126 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.489277 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.489450 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.489596 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.489695 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.489809 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.490010 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.490116 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.490317 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.490414 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.490620 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.490729 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.490942 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.491052 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.491251 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.491353 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.491556 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.491666 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.491856 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.491959 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.492163 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.492258 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.492463 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.492566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.492786 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.492901 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.493132 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.493240 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.493537 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.493660 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.493766 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.493855 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.494046 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.494208 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.494375 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.494466 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.494635 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.494731 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.494957 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.495066 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.495257 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.495354 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.495562 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.495665 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.495860 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.495954 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.496173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.496276 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.496474 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.496569 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.496797 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.496901 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.497083 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.497178 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.497386 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.497488 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.497692 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.497800 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.497994 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.498089 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.498301 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.498403 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.498601 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.498708 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.498931 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.499031 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.499232 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.499330 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.499532 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.499689 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.499830 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.499925 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.500129 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.500249 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.500477 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.500620 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.500734 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.500845 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.501023 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.501302 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.501427 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.501610 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.501748 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.501910 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.502013 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.502239 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.502348 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.502570 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.502674 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.502894 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.502989 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.503243 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.503363 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.503497 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.503648 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.503822 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.503967 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.504236 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.504347 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.504503 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.504605 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.504826 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.504922 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.505133 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.505236 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.505438 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.505521 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.505772 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.505903 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.506086 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.506190 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.506391 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.506503 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.506706 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.506841 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.507038 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.507145 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.507347 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.507451 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.507654 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.507760 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.507960 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.508063 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.508264 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.508358 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.508577 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.508685 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.508901 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.509003 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.509216 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.509319 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.509530 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.509635 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.509842 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.509938 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.510148 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.510243 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.510460 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.510554 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.510774 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.510978 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.511110 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.511205 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.511414 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.511510 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.511719 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.511855 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.512026 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.512120 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.512337 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.512432 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.512641 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.512786 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.512949 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.513054 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.513261 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.513374 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.513576 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.513689 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.513905 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.514035 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.514230 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.514337 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.514540 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.514792 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.514914 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.515145 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.515252 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.515457 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.515560 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.515777 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.515892 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.516086 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.516190 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.516420 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.516523 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.516761 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.516867 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.517082 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.517185 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.517384 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.517479 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.517629 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 03 03:48:19.517733 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.517986 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.518289 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.518596 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.518934 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.519308 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.519554 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.519890 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.520198 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.520498 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.520803 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.521106 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.521407 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.521713 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.522012 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.522319 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.522620 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.522970 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.523283 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.523599 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.523891 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.524194 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.524497 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.524796 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.525098 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.525400 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.525731 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.526065 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.526379 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.526701 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.527045 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.527374 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.527686 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.528012 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.528334 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.528645 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.528959 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.529291 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.529602 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.529912 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.530220 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.530534 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.530863 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.531172 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.531501 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.531826 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.532129 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.532453 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.532768 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.533089 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.533406 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.533711 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.534040 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.534348 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.534658 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.534983 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.535409 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.535719 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.536031 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.536337 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.536644 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.536956 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.537268 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.537594 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.537918 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.538225 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.538550 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.538893 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.539248 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.539558 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.539902 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.540230 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.540543 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.540855 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.541157 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:48:19.541399 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 03 03:48:19.578950 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO dbcounter [None req-edaf1b43-d1d9-4a51-a3ef-1a4bebbad1f4 None None] Registered counter for database nova_api Sep 03 03:48:19.599982 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_db.sqlalchemy.engines [None req-edaf1b43-d1d9-4a51-a3ef-1a4bebbad1f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132077) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 03:48:19.602563 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO dbcounter [None req-088e750e-340e-428d-b9a5-5caebb09886e None None] Registered counter for database nova_api Sep 03 03:48:19.608020 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writer thread running {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 03:48:19.623062 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_db.sqlalchemy.engines [None req-088e750e-340e-428d-b9a5-5caebb09886e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132076) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 03:48:19.629540 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writer thread running {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 03:48:19.664253 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.context [None req-edaf1b43-d1d9-4a51-a3ef-1a4bebbad1f4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f0044725-3830-4c39-ba2b-0d5fbf875774(cell1) {{(pid=132077) load_cells /opt/stack/nova/nova/context.py:464}} Sep 03 03:48:19.668340 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-edaf1b43-d1d9-4a51-a3ef-1a4bebbad1f4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:48:19.668830 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-edaf1b43-d1d9-4a51-a3ef-1a4bebbad1f4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:48:19.670466 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-edaf1b43-d1d9-4a51-a3ef-1a4bebbad1f4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:48:19.671306 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-edaf1b43-d1d9-4a51-a3ef-1a4bebbad1f4 None None] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:48:19.671779 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-edaf1b43-d1d9-4a51-a3ef-1a4bebbad1f4 None None] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:48:19.673888 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-edaf1b43-d1d9-4a51-a3ef-1a4bebbad1f4 None None] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:48:19.676091 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO dbcounter [None req-edaf1b43-d1d9-4a51-a3ef-1a4bebbad1f4 None None] Registered counter for database nova_cell0 Sep 03 03:48:19.680317 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO dbcounter [None req-edaf1b43-d1d9-4a51-a3ef-1a4bebbad1f4 None None] Registered counter for database nova_cell1 Sep 03 03:48:19.686977 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.context [None req-088e750e-340e-428d-b9a5-5caebb09886e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f0044725-3830-4c39-ba2b-0d5fbf875774(cell1) {{(pid=132076) load_cells /opt/stack/nova/nova/context.py:464}} Sep 03 03:48:19.688535 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_db.sqlalchemy.engines [None req-edaf1b43-d1d9-4a51-a3ef-1a4bebbad1f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132077) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 03:48:19.688753 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-088e750e-340e-428d-b9a5-5caebb09886e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:48:19.689267 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-088e750e-340e-428d-b9a5-5caebb09886e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:48:19.689578 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_db.sqlalchemy.engines [None req-edaf1b43-d1d9-4a51-a3ef-1a4bebbad1f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132077) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 03:48:19.690845 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-088e750e-340e-428d-b9a5-5caebb09886e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:48:19.691658 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-088e750e-340e-428d-b9a5-5caebb09886e None None] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:48:19.692101 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-088e750e-340e-428d-b9a5-5caebb09886e None None] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:48:19.694146 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-088e750e-340e-428d-b9a5-5caebb09886e None None] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:48:19.696231 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO dbcounter [None req-088e750e-340e-428d-b9a5-5caebb09886e None None] Registered counter for database nova_cell0 Sep 03 03:48:19.696865 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writer thread running {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 03:48:19.698194 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writer thread running {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 03:48:19.700560 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO dbcounter [None req-088e750e-340e-428d-b9a5-5caebb09886e None None] Registered counter for database nova_cell1 Sep 03 03:48:19.707835 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_db.sqlalchemy.engines [None req-088e750e-340e-428d-b9a5-5caebb09886e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132076) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 03:48:19.709578 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_db.sqlalchemy.engines [None req-088e750e-340e-428d-b9a5-5caebb09886e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132076) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 03:48:19.715895 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writer thread running {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 03:48:19.717232 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writer thread running {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 03:48:19.845192 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO dbcounter [None req-edaf1b43-d1d9-4a51-a3ef-1a4bebbad1f4 None None] Registered counter for database nova_cell0 Sep 03 03:48:19.852538 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_db.sqlalchemy.engines [None req-edaf1b43-d1d9-4a51-a3ef-1a4bebbad1f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132077) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 03:48:19.857815 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writer thread running {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 03:48:19.865414 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO dbcounter [None req-088e750e-340e-428d-b9a5-5caebb09886e None None] Registered counter for database nova_cell0 Sep 03 03:48:19.872351 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_db.sqlalchemy.engines [None req-088e750e-340e-428d-b9a5-5caebb09886e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132076) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 03:48:19.876980 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writer thread running {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 03:48:20.183987 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: WARNING keystonemiddleware.auth_token [None req-edaf1b43-d1d9-4a51-a3ef-1a4bebbad1f4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 03 03:48:20.190582 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: WARNING keystonemiddleware.auth_token [None req-088e750e-340e-428d-b9a5-5caebb09886e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 03 03:48:20.191447 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: WARNING keystonemiddleware.auth_token [None req-edaf1b43-d1d9-4a51-a3ef-1a4bebbad1f4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 03 03:48:20.197845 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: WARNING keystonemiddleware.auth_token [None req-088e750e-340e-428d-b9a5-5caebb09886e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 03 03:48:20.541567 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: WARNING keystonemiddleware.auth_token [None req-088e750e-340e-428d-b9a5-5caebb09886e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 03 03:48:20.544277 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: WARNING keystonemiddleware.auth_token [None req-edaf1b43-d1d9-4a51-a3ef-1a4bebbad1f4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 03 03:48:20.547680 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: WARNING keystonemiddleware.auth_token [None req-088e750e-340e-428d-b9a5-5caebb09886e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 03 03:48:20.550393 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: WARNING keystonemiddleware.auth_token [None req-edaf1b43-d1d9-4a51-a3ef-1a4bebbad1f4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 03 03:48:20.553048 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fd113ff9c0 pid: 132076 (default app) Sep 03 03:48:20.555815 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fd113ff9c0 pid: 132077 (default app) Sep 03 03:48:54.921566 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_api:SELECT=3 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:48:54.923104 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell1:SELECT=3 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:48:54.923892 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell0:SELECT=3 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:48:54.924658 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell0:SELECT=3 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:48:56.151915 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-ff1f1d29-ea1d-485f-ac5f-5c61b981594b tempest-VolumesGetTestJSON-222612045 tempest-VolumesGetTestJSON-222612045-project] Action: 'create', calling method: .version_select at 0x7f45fd639280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1249173409", "metadata": {"Type": "work"}}} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:48:56.559731 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_api:SELECT=3 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:48:56.563938 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell0:SELECT=3 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:48:56.566911 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell1:SELECT=3 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:48:56.568372 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell0:SELECT=3 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:48:57.779325 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-2d48e32a-210d-414b-a904-d78e0a7e0c1c tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] Action: 'create', calling method: .version_select at 0x7f45fd638310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-468853269"}} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:48:58.365977 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-ff1f1d29-ea1d-485f-ac5f-5c61b981594b tempest-VolumesGetTestJSON-222612045 tempest-VolumesGetTestJSON-222612045-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.454886 Sep 03 03:48:58.366610 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 1/1] 10.222.0.25 () {60 vars in 1156 bytes} [Sat Sep 3 03:48:54 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3457 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 03 03:48:58.503164 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-240b1372-478a-4f3b-90a4-c335edb8a308 tempest-VolumesGetTestJSON-222612045 tempest-VolumesGetTestJSON-222612045-project] Calling method '.version_select at 0x7f45fd51b160>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:48:58.542505 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-240b1372-478a-4f3b-90a4-c335edb8a308 tempest-VolumesGetTestJSON-222612045 tempest-VolumesGetTestJSON-222612045-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/4e6a41c0-9109-4736-b203-7597f03c8d3b" status: 200 len: 353 microversion: 2.1 time: 0.161994 Sep 03 03:48:58.543502 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 2/2] 10.222.0.25 () {58 vars in 1245 bytes} [Sat Sep 3 03:48:58 2022] GET /compute/v2.1/os-volumes/4e6a41c0-9109-4736-b203-7597f03c8d3b => generated 353 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:48:59.144952 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-2d48e32a-210d-414b-a904-d78e0a7e0c1c tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.601528 Sep 03 03:48:59.146740 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 1/3] 10.222.0.25 () {60 vars in 1155 bytes} [Sat Sep 3 03:48:56 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2605 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 03 03:48:59.163096 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-a85c6931-a98f-492b-9001-6f071592ea80 tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] Calling method '.version_select at 0x7f45fd51b820>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:48:59.283093 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-a85c6931-a98f-492b-9001-6f071592ea80 tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/45c4d31f-74ba-4728-a36f-b0d7492c39c5" status: 200 len: 344 microversion: 2.1 time: 0.125688 Sep 03 03:48:59.284123 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 3/4] 10.222.0.25 () {58 vars in 1245 bytes} [Sat Sep 3 03:48:59 2022] GET /compute/v2.1/os-volumes/45c4d31f-74ba-4728-a36f-b0d7492c39c5 => generated 344 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:48:59.564269 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-593bf958-c161-4ec4-bac3-aeab3b19abb5 tempest-VolumesGetTestJSON-222612045 tempest-VolumesGetTestJSON-222612045-project] Calling method '.version_select at 0x7f45fd51b1f0>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:48:59.685793 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-593bf958-c161-4ec4-bac3-aeab3b19abb5 tempest-VolumesGetTestJSON-222612045 tempest-VolumesGetTestJSON-222612045-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/4e6a41c0-9109-4736-b203-7597f03c8d3b" status: 200 len: 354 microversion: 2.1 time: 0.131368 Sep 03 03:48:59.686407 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 2/5] 10.222.0.25 () {58 vars in 1245 bytes} [Sat Sep 3 03:48:59 2022] GET /compute/v2.1/os-volumes/4e6a41c0-9109-4736-b203-7597f03c8d3b => generated 354 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:48:59.700282 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-588dc7c0-f26e-4ec6-8d9f-3d37c13e9679 tempest-VolumesGetTestJSON-222612045 tempest-VolumesGetTestJSON-222612045-project] Calling method '.version_select at 0x7f45fd51bf70>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:48:59.794537 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-588dc7c0-f26e-4ec6-8d9f-3d37c13e9679 tempest-VolumesGetTestJSON-222612045 tempest-VolumesGetTestJSON-222612045-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/4e6a41c0-9109-4736-b203-7597f03c8d3b" status: 200 len: 354 microversion: 2.1 time: 0.098406 Sep 03 03:48:59.795446 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 4/6] 10.222.0.25 () {58 vars in 1245 bytes} [Sat Sep 3 03:48:59 2022] GET /compute/v2.1/os-volumes/4e6a41c0-9109-4736-b203-7597f03c8d3b => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:48:59.811207 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-11276fc6-4fc6-41a5-9bf5-d4fdccb7b363 tempest-VolumesGetTestJSON-222612045 tempest-VolumesGetTestJSON-222612045-project] Calling method '.version_select at 0x7f45fd51b940>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:00.120797 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-11276fc6-4fc6-41a5-9bf5-d4fdccb7b363 tempest-VolumesGetTestJSON-222612045 tempest-VolumesGetTestJSON-222612045-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/4e6a41c0-9109-4736-b203-7597f03c8d3b" status: 202 len: 0 microversion: 2.1 time: 0.314951 Sep 03 03:49:00.122445 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 3/7] 10.222.0.25 () {58 vars in 1248 bytes} [Sat Sep 3 03:48:59 2022] DELETE /compute/v2.1/os-volumes/4e6a41c0-9109-4736-b203-7597f03c8d3b => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 03:49:00.142388 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-8a7e8816-19d0-4162-a1d5-a1457e3482ce tempest-VolumesGetTestJSON-222612045 tempest-VolumesGetTestJSON-222612045-project] Calling method '.version_select at 0x7f45fd51baf0>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:00.242316 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-8a7e8816-19d0-4162-a1d5-a1457e3482ce tempest-VolumesGetTestJSON-222612045 tempest-VolumesGetTestJSON-222612045-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/4e6a41c0-9109-4736-b203-7597f03c8d3b" status: 200 len: 353 microversion: 2.1 time: 0.115384 Sep 03 03:49:00.243220 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 5/8] 10.222.0.25 () {58 vars in 1245 bytes} [Sat Sep 3 03:49:00 2022] GET /compute/v2.1/os-volumes/4e6a41c0-9109-4736-b203-7597f03c8d3b => generated 353 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:49:00.301254 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-6b58d5a0-094d-4f80-b4f3-d80b1b3a4e45 tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] Calling method '.version_select at 0x7f45fd519040>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:00.443580 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-6b58d5a0-094d-4f80-b4f3-d80b1b3a4e45 tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/45c4d31f-74ba-4728-a36f-b0d7492c39c5" status: 200 len: 345 microversion: 2.1 time: 0.114849 Sep 03 03:49:00.443580 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 4/9] 10.222.0.25 () {58 vars in 1245 bytes} [Sat Sep 3 03:49:00 2022] GET /compute/v2.1/os-volumes/45c4d31f-74ba-4728-a36f-b0d7492c39c5 => generated 345 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:49:00.449415 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-9a74716a-1923-496b-ac0f-addc72772fa2 tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] Action: 'create', calling method: .version_select at 0x7f45fd51b4c0>, body: {"snapshot": {"volume_id": "45c4d31f-74ba-4728-a36f-b0d7492c39c5", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1186276977"}} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:49:00.986396 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-9a74716a-1923-496b-ac0f-addc72772fa2 tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.563835 Sep 03 03:49:01.000574 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 6/10] 10.222.0.25 () {60 vars in 1162 bytes} [Sat Sep 3 03:49:00 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:49:01.005469 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-8d962c03-0df7-4866-8061-5eef181c1512 tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] Calling method '.version_select at 0x7f45fd51bdc0>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:01.142882 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-8d962c03-0df7-4866-8061-5eef181c1512 tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/864b4de5-2a28-496b-a3a1-76bfd3587c9a" status: 200 len: 287 microversion: 2.1 time: 0.146499 Sep 03 03:49:01.157066 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 5/11] 10.222.0.25 () {58 vars in 1251 bytes} [Sat Sep 3 03:49:00 2022] GET /compute/v2.1/os-snapshots/864b4de5-2a28-496b-a3a1-76bfd3587c9a => generated 287 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:49:01.162338 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-ebb232f0-b272-4851-ada7-b193a4e32502 tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] Calling method '.version_select at 0x7f45fd4a9a60>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:01.253027 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-ebb232f0-b272-4851-ada7-b193a4e32502 tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.097930 Sep 03 03:49:01.258027 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-bba4a210-3daf-4ef3-936a-76a5feb24248 tempest-VolumesGetTestJSON-222612045 tempest-VolumesGetTestJSON-222612045-project] Calling method '.version_select at 0x7f45fd51b790>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:01.261011 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 7/12] 10.222.0.25 () {58 vars in 1140 bytes} [Sat Sep 3 03:49:01 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 03:49:01.266050 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-5703c6d2-498d-415d-86ee-36176a3cfa00 tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] Calling method '.version_select at 0x7f45fd4a99d0>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:01.312212 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.wsgi [None req-bba4a210-3daf-4ef3-936a-76a5feb24248 tempest-VolumesGetTestJSON-222612045 tempest-VolumesGetTestJSON-222612045-project] HTTP exception thrown: Volume 4e6a41c0-9109-4736-b203-7597f03c8d3b could not be found. Sep 03 03:49:01.319588 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-bba4a210-3daf-4ef3-936a-76a5feb24248 tempest-VolumesGetTestJSON-222612045 tempest-VolumesGetTestJSON-222612045-project] Request method failure captured: Sep 03 03:49:01.319588 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: request: GET /compute/v2.1/os-volumes/4e6a41c0-9109-4736-b203-7597f03c8d3b HTTP/1.1 Sep 03 03:49:01.319588 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept: application/json Sep 03 03:49:01.319588 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept-Encoding: identity Sep 03 03:49:01.319588 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Connection: close Sep 03 03:49:01.319588 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Length: 0 Sep 03 03:49:01.319588 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Type: application/json Sep 03 03:49:01.319588 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Host: 10.222.0.25 Sep 03 03:49:01.319588 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Openstack-System-Scope: None Sep 03 03:49:01.319588 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: User-Agent: python-urllib3/1.26.12 Sep 03 03:49:01.319588 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Auth-Token: gAAAAABjEs6mzgcYcDD0P5MAxp19Vzb8PI2v9EquS6jtWvKSEKFvaswL_xYS5478jWnCFZFh9WtoBIpEIzR8dSWYFAdL6wL_sQZ5ltSgcWer8yerd5WeUH5-NGG6GOib_6yZAULs8H4iO4uH_4Vi9nkEEoiQZF4BH40gBgLtqYYoKH4KYfFPzvg Sep 03 03:49:01.319588 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Id: None Sep 03 03:49:01.319588 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Name: None Sep 03 03:49:01.319588 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Identity-Status: Confirmed Sep 03 03:49:01.319588 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Is-Admin-Project: True Sep 03 03:49:01.319588 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Id: default Sep 03 03:49:01.319588 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Name: Default Sep 03 03:49:01.319588 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Id: 798ac7907fc047889ade5c052b2140fb Sep 03 03:49:01.319588 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Name: tempest-VolumesGetTestJSON-222612045 Sep 03 03:49:01.319588 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Role: member,reader Sep 03 03:49:01.319588 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Roles: member,reader Sep 03 03:49:01.320539 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/798ac7907fc047889ade5c052b2140fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_798ac7907fc047889ade5c052b2140fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/798ac7907fc047889ade5c052b2140fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/798ac7907fc047889ade5c052b2140fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:49:01.320539 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant: tempest-VolumesGetTestJSON-222612045 Sep 03 03:49:01.320539 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Id: 798ac7907fc047889ade5c052b2140fb Sep 03 03:49:01.320539 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Name: tempest-VolumesGetTestJSON-222612045 Sep 03 03:49:01.320539 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User: tempest-VolumesGetTestJSON-222612045-project Sep 03 03:49:01.320539 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Id: default Sep 03 03:49:01.320539 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Name: Default Sep 03 03:49:01.320539 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Id: d1801a169eec4a388c4438f93ddc2779 Sep 03 03:49:01.320539 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Name: tempest-VolumesGetTestJSON-222612045-project Sep 03 03:49:01.320539 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: method: Sep 03 03:49:01.320539 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: exception: Volume 4e6a41c0-9109-4736-b203-7597f03c8d3b could not be found. Sep 03 03:49:01.320539 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: action_args: {'id': '4e6a41c0-9109-4736-b203-7597f03c8d3b'} Sep 03 03:49:01.320539 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:49:01.321125 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:49:01.321125 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 03 03:49:01.321125 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 03 03:49:01.321125 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 03 03:49:01.321125 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 03 03:49:01.321125 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 03 03:49:01.321125 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 03 03:49:01.321125 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 03 03:49:01.321125 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 03 03:49:01.321125 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 03 03:49:01.321125 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 03 03:49:01.321125 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 03:49:01.321125 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 03:49:01.321125 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 03:49:01.321125 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 03:49:01.321125 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4e6a41c0-9109-4736-b203-7597f03c8d3b could not be found. (HTTP 404) (Request-ID: req-adb62fbc-0ce4-4cc2-8244-7f5eafcafa94) Sep 03 03:49:01.321125 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:49:01.321125 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:49:01.321125 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:49:01.325460 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:49:01.325460 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 03 03:49:01.325460 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 03 03:49:01.325460 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 03 03:49:01.325460 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 03 03:49:01.325460 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 03 03:49:01.325460 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 03 03:49:01.325460 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 03 03:49:01.325460 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 03 03:49:01.325460 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 03 03:49:01.325460 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 03 03:49:01.325460 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 03 03:49:01.325460 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 03 03:49:01.325460 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 03 03:49:01.325460 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 03 03:49:01.325460 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 03 03:49:01.325460 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 03 03:49:01.325460 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 03 03:49:01.325460 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 03 03:49:01.326280 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 03:49:01.326280 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 03:49:01.326280 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 03:49:01.326280 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 03:49:01.326280 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4e6a41c0-9109-4736-b203-7597f03c8d3b could not be found. Sep 03 03:49:01.326280 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:49:01.326280 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:49:01.326280 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:49:01.326280 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:49:01.326280 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:49:01.326280 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:49:01.326280 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:49:01.326280 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:49:01.326280 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 03:49:01.326280 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 03:49:01.326280 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:49:01.326280 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:49:01.326280 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 03 03:49:01.326280 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:49:01.327546 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4e6a41c0-9109-4736-b203-7597f03c8d3b could not be found. Sep 03 03:49:01.327546 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:49:01.327546 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:49:01.327546 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:49:01.327546 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:49:01.327546 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:49:01.327546 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:49:01.327546 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:49:01.327546 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:49:01.327546 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4e6a41c0-9109-4736-b203-7597f03c8d3b could not be found. Sep 03 03:49:01.327546 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:49:01.327546 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-bba4a210-3daf-4ef3-936a-76a5feb24248 tempest-VolumesGetTestJSON-222612045 tempest-VolumesGetTestJSON-222612045-project] Returning 404 to user: Volume 4e6a41c0-9109-4736-b203-7597f03c8d3b could not be found. {{(pid=132077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:49:01.327546 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-bba4a210-3daf-4ef3-936a-76a5feb24248 tempest-VolumesGetTestJSON-222612045 tempest-VolumesGetTestJSON-222612045-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/4e6a41c0-9109-4736-b203-7597f03c8d3b" status: 404 len: 109 microversion: 2.1 time: 0.067569 Sep 03 03:49:01.335042 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 6/13] 10.222.0.25 () {58 vars in 1245 bytes} [Sat Sep 3 03:49:01 2022] GET /compute/v2.1/os-volumes/4e6a41c0-9109-4736-b203-7597f03c8d3b => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 03:49:01.366335 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-5703c6d2-498d-415d-86ee-36176a3cfa00 tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/864b4de5-2a28-496b-a3a1-76bfd3587c9a" status: 200 len: 287 microversion: 2.1 time: 0.104127 Sep 03 03:49:01.366981 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 8/14] 10.222.0.25 () {58 vars in 1251 bytes} [Sat Sep 3 03:49:01 2022] GET /compute/v2.1/os-snapshots/864b4de5-2a28-496b-a3a1-76bfd3587c9a => generated 287 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:49:02.379059 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-ee9282dd-082e-4aa6-b2bb-4d91c7e5249c tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] Calling method '.version_select at 0x7f45fd4759d0>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:02.421848 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-ee9282dd-082e-4aa6-b2bb-4d91c7e5249c tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/864b4de5-2a28-496b-a3a1-76bfd3587c9a" status: 200 len: 287 microversion: 2.1 time: 0.046366 Sep 03 03:49:02.423591 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 7/15] 10.222.0.25 () {58 vars in 1251 bytes} [Sat Sep 3 03:49:02 2022] GET /compute/v2.1/os-snapshots/864b4de5-2a28-496b-a3a1-76bfd3587c9a => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:49:03.439332 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-30a0ff39-8630-46b4-a3dd-2b294762d96f tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] Calling method '.version_select at 0x7f45fd4a93a0>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:03.496758 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-30a0ff39-8630-46b4-a3dd-2b294762d96f tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/864b4de5-2a28-496b-a3a1-76bfd3587c9a" status: 200 len: 287 microversion: 2.1 time: 0.064326 Sep 03 03:49:03.500701 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 9/16] 10.222.0.25 () {58 vars in 1251 bytes} [Sat Sep 3 03:49:03 2022] GET /compute/v2.1/os-snapshots/864b4de5-2a28-496b-a3a1-76bfd3587c9a => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:49:04.510044 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-327f5953-2b5a-44a9-9895-74d87f333f73 tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] Calling method '.version_select at 0x7f45fd4890d0>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:04.595743 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-327f5953-2b5a-44a9-9895-74d87f333f73 tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/864b4de5-2a28-496b-a3a1-76bfd3587c9a" status: 200 len: 288 microversion: 2.1 time: 0.090038 Sep 03 03:49:04.596308 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 8/17] 10.222.0.25 () {58 vars in 1251 bytes} [Sat Sep 3 03:49:04 2022] GET /compute/v2.1/os-snapshots/864b4de5-2a28-496b-a3a1-76bfd3587c9a => generated 288 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:49:04.608214 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-ae208f0b-bf46-43d2-9374-4306c1ec1d1b tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] Calling method '.version_select at 0x7f45fd4a23a0>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:04.745180 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-ae208f0b-bf46-43d2-9374-4306c1ec1d1b tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/864b4de5-2a28-496b-a3a1-76bfd3587c9a" status: 202 len: 0 microversion: 2.1 time: 0.141000 Sep 03 03:49:04.745989 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 10/18] 10.222.0.25 () {58 vars in 1254 bytes} [Sat Sep 3 03:49:04 2022] DELETE /compute/v2.1/os-snapshots/864b4de5-2a28-496b-a3a1-76bfd3587c9a => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 03:49:04.755368 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-b5c960e4-46ff-4348-8efd-813c17b9bc97 tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] Calling method '.version_select at 0x7f45fd489790>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:04.819732 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-b5c960e4-46ff-4348-8efd-813c17b9bc97 tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/864b4de5-2a28-496b-a3a1-76bfd3587c9a" status: 200 len: 287 microversion: 2.1 time: 0.068802 Sep 03 03:49:04.820297 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 9/19] 10.222.0.25 () {58 vars in 1251 bytes} [Sat Sep 3 03:49:04 2022] GET /compute/v2.1/os-snapshots/864b4de5-2a28-496b-a3a1-76bfd3587c9a => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:49:05.832432 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-5edb53ad-1005-42a3-92a6-6435d4dbccca tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] Calling method '.version_select at 0x7f45fd4a9160>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:05.907176 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.wsgi [None req-5edb53ad-1005-42a3-92a6-6435d4dbccca tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] HTTP exception thrown: Snapshot 864b4de5-2a28-496b-a3a1-76bfd3587c9a could not be found. Sep 03 03:49:05.911879 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-5edb53ad-1005-42a3-92a6-6435d4dbccca tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] Request method failure captured: Sep 03 03:49:05.911879 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: request: GET /compute/v2.1/os-snapshots/864b4de5-2a28-496b-a3a1-76bfd3587c9a HTTP/1.1 Sep 03 03:49:05.911879 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept: application/json Sep 03 03:49:05.911879 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept-Encoding: identity Sep 03 03:49:05.911879 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Connection: close Sep 03 03:49:05.911879 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Length: 0 Sep 03 03:49:05.911879 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Type: application/json Sep 03 03:49:05.911879 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Host: 10.222.0.25 Sep 03 03:49:05.911879 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Openstack-System-Scope: None Sep 03 03:49:05.911879 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: User-Agent: python-urllib3/1.26.12 Sep 03 03:49:05.911879 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Auth-Token: gAAAAABjEs6o6lydCjIRbwcnCufGsIXAGDktjz9kRNrSN3OZiEFo9NWBCOtddl2BebNRWNUBKS2EgQzyTa67CjMLDLEwKWPkIoGyCh3p4n_XBbJz_wcZ0ucGZ2DSiGsT-0vXZlRWelPWtip9vYOduvC6B1JwZ08cQL8fadRkyhQl-nKZzUdm9J0 Sep 03 03:49:05.911879 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Id: None Sep 03 03:49:05.911879 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Name: None Sep 03 03:49:05.911879 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Identity-Status: Confirmed Sep 03 03:49:05.911879 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Is-Admin-Project: True Sep 03 03:49:05.911879 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Id: default Sep 03 03:49:05.911879 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Name: Default Sep 03 03:49:05.911879 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Id: 5404143f5ac54f778c649bee74e51c13 Sep 03 03:49:05.911879 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-893015269 Sep 03 03:49:05.911879 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Role: member,reader Sep 03 03:49:05.911879 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Roles: member,reader Sep 03 03:49:05.912961 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5404143f5ac54f778c649bee74e51c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5404143f5ac54f778c649bee74e51c13"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5404143f5ac54f778c649bee74e51c13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5404143f5ac54f778c649bee74e51c13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:49:05.912961 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant: tempest-VolumesSnapshotsTestJSON-893015269 Sep 03 03:49:05.912961 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Id: 5404143f5ac54f778c649bee74e51c13 Sep 03 03:49:05.912961 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-893015269 Sep 03 03:49:05.912961 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User: tempest-VolumesSnapshotsTestJSON-893015269-project Sep 03 03:49:05.912961 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Id: default Sep 03 03:49:05.912961 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Name: Default Sep 03 03:49:05.912961 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Id: f4b3f2822726453a9f39e0b2bb76b5ef Sep 03 03:49:05.912961 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Name: tempest-VolumesSnapshotsTestJSON-893015269-project Sep 03 03:49:05.912961 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: method: Sep 03 03:49:05.912961 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: exception: Snapshot 864b4de5-2a28-496b-a3a1-76bfd3587c9a could not be found. Sep 03 03:49:05.912961 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: action_args: {'id': '864b4de5-2a28-496b-a3a1-76bfd3587c9a'} Sep 03 03:49:05.912961 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:49:05.913691 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:49:05.913691 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 03 03:49:05.913691 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 03 03:49:05.913691 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 03 03:49:05.913691 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 03 03:49:05.913691 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 03 03:49:05.913691 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 03 03:49:05.913691 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 03 03:49:05.913691 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 03 03:49:05.913691 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 03 03:49:05.913691 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 03 03:49:05.913691 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 03:49:05.913691 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 03:49:05.913691 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 03:49:05.913691 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 03:49:05.913691 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 864b4de5-2a28-496b-a3a1-76bfd3587c9a could not be found. (HTTP 404) (Request-ID: req-834fded7-ec9a-455d-897f-a4a0aa02c9bc) Sep 03 03:49:05.913691 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:49:05.913691 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:49:05.918626 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:49:05.918626 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:49:05.918626 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 03 03:49:05.918626 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 03 03:49:05.918626 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 03 03:49:05.918626 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 03 03:49:05.918626 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 03 03:49:05.918626 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 03 03:49:05.918626 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 03 03:49:05.918626 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 03 03:49:05.918626 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 03 03:49:05.918626 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 03 03:49:05.918626 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 03 03:49:05.918626 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 03 03:49:05.918626 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 03 03:49:05.918626 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 03 03:49:05.918626 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 03 03:49:05.918626 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 03 03:49:05.918626 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 03 03:49:05.919568 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 03 03:49:05.919568 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 03:49:05.919568 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 03:49:05.919568 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 03:49:05.919568 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 03:49:05.919568 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 864b4de5-2a28-496b-a3a1-76bfd3587c9a could not be found. Sep 03 03:49:05.919568 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:49:05.919568 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:49:05.919568 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:49:05.919568 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:49:05.919568 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:49:05.919568 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:49:05.919568 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:49:05.919568 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:49:05.919568 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 03:49:05.919568 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 03:49:05.919568 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:49:05.919568 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:49:05.919568 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 03 03:49:05.919568 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:49:05.920473 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 864b4de5-2a28-496b-a3a1-76bfd3587c9a could not be found. Sep 03 03:49:05.920473 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:49:05.920473 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:49:05.920473 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:49:05.920473 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:49:05.920473 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:49:05.920473 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:49:05.920473 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:49:05.920473 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:49:05.920473 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 864b4de5-2a28-496b-a3a1-76bfd3587c9a could not be found. Sep 03 03:49:05.920473 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:49:05.920473 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-5edb53ad-1005-42a3-92a6-6435d4dbccca tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] Returning 404 to user: Snapshot 864b4de5-2a28-496b-a3a1-76bfd3587c9a could not be found. {{(pid=132076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:49:05.920473 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-5edb53ad-1005-42a3-92a6-6435d4dbccca tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/864b4de5-2a28-496b-a3a1-76bfd3587c9a" status: 404 len: 111 microversion: 2.1 time: 0.084702 Sep 03 03:49:05.920473 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 11/20] 10.222.0.25 () {58 vars in 1251 bytes} [Sat Sep 3 03:49:05 2022] GET /compute/v2.1/os-snapshots/864b4de5-2a28-496b-a3a1-76bfd3587c9a => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 03:49:05.922762 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-8a454d0a-4283-42a8-9640-6ae0e1eac740 tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] Calling method '.version_select at 0x7f45fd475ca0>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:06.211782 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-8a454d0a-4283-42a8-9640-6ae0e1eac740 tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/45c4d31f-74ba-4728-a36f-b0d7492c39c5" status: 202 len: 0 microversion: 2.1 time: 0.293086 Sep 03 03:49:06.215594 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 10/21] 10.222.0.25 () {58 vars in 1248 bytes} [Sat Sep 3 03:49:05 2022] DELETE /compute/v2.1/os-volumes/45c4d31f-74ba-4728-a36f-b0d7492c39c5 => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 03:49:06.221347 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-79279d79-daca-4e1d-97f0-b5cd298b0667 tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] Calling method '.version_select at 0x7f45fde678b0>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:06.408154 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-79279d79-daca-4e1d-97f0-b5cd298b0667 tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/45c4d31f-74ba-4728-a36f-b0d7492c39c5" status: 200 len: 344 microversion: 2.1 time: 0.191012 Sep 03 03:49:06.409045 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 12/22] 10.222.0.25 () {58 vars in 1245 bytes} [Sat Sep 3 03:49:06 2022] GET /compute/v2.1/os-volumes/45c4d31f-74ba-4728-a36f-b0d7492c39c5 => generated 344 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:49:07.423796 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-dc853d8a-3aef-4948-9f28-a8481a8bec6e tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] Calling method '.version_select at 0x7f45fd489a60>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:07.504461 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.wsgi [None req-dc853d8a-3aef-4948-9f28-a8481a8bec6e tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] HTTP exception thrown: Volume 45c4d31f-74ba-4728-a36f-b0d7492c39c5 could not be found. Sep 03 03:49:07.508529 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-dc853d8a-3aef-4948-9f28-a8481a8bec6e tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] Request method failure captured: Sep 03 03:49:07.508529 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: request: GET /compute/v2.1/os-volumes/45c4d31f-74ba-4728-a36f-b0d7492c39c5 HTTP/1.1 Sep 03 03:49:07.508529 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept: application/json Sep 03 03:49:07.508529 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept-Encoding: identity Sep 03 03:49:07.508529 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Connection: close Sep 03 03:49:07.508529 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Length: 0 Sep 03 03:49:07.508529 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Type: application/json Sep 03 03:49:07.508529 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Host: 10.222.0.25 Sep 03 03:49:07.508529 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Openstack-System-Scope: None Sep 03 03:49:07.508529 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: User-Agent: python-urllib3/1.26.12 Sep 03 03:49:07.508529 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Auth-Token: gAAAAABjEs6o6lydCjIRbwcnCufGsIXAGDktjz9kRNrSN3OZiEFo9NWBCOtddl2BebNRWNUBKS2EgQzyTa67CjMLDLEwKWPkIoGyCh3p4n_XBbJz_wcZ0ucGZ2DSiGsT-0vXZlRWelPWtip9vYOduvC6B1JwZ08cQL8fadRkyhQl-nKZzUdm9J0 Sep 03 03:49:07.508529 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Id: None Sep 03 03:49:07.508529 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Name: None Sep 03 03:49:07.508529 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Identity-Status: Confirmed Sep 03 03:49:07.508529 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Is-Admin-Project: True Sep 03 03:49:07.508529 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Id: default Sep 03 03:49:07.508529 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Name: Default Sep 03 03:49:07.508529 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Id: 5404143f5ac54f778c649bee74e51c13 Sep 03 03:49:07.508529 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-893015269 Sep 03 03:49:07.508529 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Role: member,reader Sep 03 03:49:07.508529 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Roles: member,reader Sep 03 03:49:07.509578 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5404143f5ac54f778c649bee74e51c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5404143f5ac54f778c649bee74e51c13"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5404143f5ac54f778c649bee74e51c13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5404143f5ac54f778c649bee74e51c13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:49:07.509578 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant: tempest-VolumesSnapshotsTestJSON-893015269 Sep 03 03:49:07.509578 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Id: 5404143f5ac54f778c649bee74e51c13 Sep 03 03:49:07.509578 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-893015269 Sep 03 03:49:07.509578 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User: tempest-VolumesSnapshotsTestJSON-893015269-project Sep 03 03:49:07.509578 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Id: default Sep 03 03:49:07.509578 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Name: Default Sep 03 03:49:07.509578 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Id: f4b3f2822726453a9f39e0b2bb76b5ef Sep 03 03:49:07.509578 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Name: tempest-VolumesSnapshotsTestJSON-893015269-project Sep 03 03:49:07.509578 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: method: Sep 03 03:49:07.509578 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: exception: Volume 45c4d31f-74ba-4728-a36f-b0d7492c39c5 could not be found. Sep 03 03:49:07.509578 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: action_args: {'id': '45c4d31f-74ba-4728-a36f-b0d7492c39c5'} Sep 03 03:49:07.509578 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:49:07.510294 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:49:07.510294 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 03 03:49:07.510294 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 03 03:49:07.510294 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 03 03:49:07.510294 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 03 03:49:07.510294 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 03 03:49:07.510294 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 03 03:49:07.510294 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 03 03:49:07.510294 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 03 03:49:07.510294 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 03 03:49:07.510294 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 03 03:49:07.510294 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 03:49:07.510294 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 03:49:07.510294 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 03:49:07.510294 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 03:49:07.510294 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 45c4d31f-74ba-4728-a36f-b0d7492c39c5 could not be found. (HTTP 404) (Request-ID: req-8ef5dda8-4cce-4b9d-8c80-42db871e3c2a) Sep 03 03:49:07.510294 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:49:07.510294 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:49:07.510294 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:49:07.511252 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:49:07.511252 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 03 03:49:07.511252 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 03 03:49:07.511252 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 03 03:49:07.511252 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 03 03:49:07.511252 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 03 03:49:07.511252 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 03 03:49:07.511252 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 03 03:49:07.511252 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 03 03:49:07.511252 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 03 03:49:07.511252 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 03 03:49:07.511252 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 03 03:49:07.511252 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 03 03:49:07.511252 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 03 03:49:07.511252 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 03 03:49:07.511252 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 03 03:49:07.511252 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 03 03:49:07.511252 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 03 03:49:07.511252 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 03 03:49:07.512145 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 03:49:07.512145 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 03:49:07.512145 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 03:49:07.512145 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 03:49:07.512145 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 45c4d31f-74ba-4728-a36f-b0d7492c39c5 could not be found. Sep 03 03:49:07.512145 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:49:07.512145 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:49:07.512145 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:49:07.512145 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:49:07.512145 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:49:07.512145 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:49:07.512145 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:49:07.512145 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:49:07.512145 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 03:49:07.512145 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 03:49:07.512145 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:49:07.512145 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:49:07.512145 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 03 03:49:07.512145 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:49:07.513012 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 45c4d31f-74ba-4728-a36f-b0d7492c39c5 could not be found. Sep 03 03:49:07.513012 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:49:07.513012 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:49:07.513012 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:49:07.513012 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:49:07.513012 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:49:07.513012 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:49:07.513012 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:49:07.513012 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:49:07.513012 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 45c4d31f-74ba-4728-a36f-b0d7492c39c5 could not be found. Sep 03 03:49:07.513012 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:49:07.513012 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-dc853d8a-3aef-4948-9f28-a8481a8bec6e tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] Returning 404 to user: Volume 45c4d31f-74ba-4728-a36f-b0d7492c39c5 could not be found. {{(pid=132077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:49:07.513012 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-dc853d8a-3aef-4948-9f28-a8481a8bec6e tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/45c4d31f-74ba-4728-a36f-b0d7492c39c5" status: 404 len: 109 microversion: 2.1 time: 0.090507 Sep 03 03:49:07.524355 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-491a33e2-5c08-4460-a52c-029115b3e862 tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] Calling method '.version_select at 0x7f45fd639280>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:07.526881 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 11/23] 10.222.0.25 () {58 vars in 1245 bytes} [Sat Sep 3 03:49:07 2022] GET /compute/v2.1/os-volumes/45c4d31f-74ba-4728-a36f-b0d7492c39c5 => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 03:49:07.610948 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.wsgi [None req-491a33e2-5c08-4460-a52c-029115b3e862 tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] HTTP exception thrown: Volume 45c4d31f-74ba-4728-a36f-b0d7492c39c5 could not be found. Sep 03 03:49:07.613561 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-491a33e2-5c08-4460-a52c-029115b3e862 tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] Request method failure captured: Sep 03 03:49:07.613561 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: request: DELETE /compute/v2.1/os-volumes/45c4d31f-74ba-4728-a36f-b0d7492c39c5 HTTP/1.1 Sep 03 03:49:07.613561 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept: application/json Sep 03 03:49:07.613561 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept-Encoding: identity Sep 03 03:49:07.613561 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Connection: close Sep 03 03:49:07.613561 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Length: 0 Sep 03 03:49:07.613561 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Type: application/json Sep 03 03:49:07.613561 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Host: 10.222.0.25 Sep 03 03:49:07.613561 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Openstack-System-Scope: None Sep 03 03:49:07.613561 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: User-Agent: python-urllib3/1.26.12 Sep 03 03:49:07.613561 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Auth-Token: gAAAAABjEs6o6lydCjIRbwcnCufGsIXAGDktjz9kRNrSN3OZiEFo9NWBCOtddl2BebNRWNUBKS2EgQzyTa67CjMLDLEwKWPkIoGyCh3p4n_XBbJz_wcZ0ucGZ2DSiGsT-0vXZlRWelPWtip9vYOduvC6B1JwZ08cQL8fadRkyhQl-nKZzUdm9J0 Sep 03 03:49:07.613561 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Id: None Sep 03 03:49:07.613561 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Name: None Sep 03 03:49:07.613561 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Identity-Status: Confirmed Sep 03 03:49:07.613561 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Is-Admin-Project: True Sep 03 03:49:07.613561 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Id: default Sep 03 03:49:07.613561 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Name: Default Sep 03 03:49:07.613561 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Id: 5404143f5ac54f778c649bee74e51c13 Sep 03 03:49:07.613561 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-893015269 Sep 03 03:49:07.613561 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Role: member,reader Sep 03 03:49:07.613561 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Roles: member,reader Sep 03 03:49:07.614837 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5404143f5ac54f778c649bee74e51c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5404143f5ac54f778c649bee74e51c13"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5404143f5ac54f778c649bee74e51c13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5404143f5ac54f778c649bee74e51c13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:49:07.614837 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant: tempest-VolumesSnapshotsTestJSON-893015269 Sep 03 03:49:07.614837 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Id: 5404143f5ac54f778c649bee74e51c13 Sep 03 03:49:07.614837 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-893015269 Sep 03 03:49:07.614837 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User: tempest-VolumesSnapshotsTestJSON-893015269-project Sep 03 03:49:07.614837 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Id: default Sep 03 03:49:07.614837 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Name: Default Sep 03 03:49:07.614837 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Id: f4b3f2822726453a9f39e0b2bb76b5ef Sep 03 03:49:07.614837 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Name: tempest-VolumesSnapshotsTestJSON-893015269-project Sep 03 03:49:07.614837 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: method: Sep 03 03:49:07.614837 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: exception: Volume 45c4d31f-74ba-4728-a36f-b0d7492c39c5 could not be found. Sep 03 03:49:07.614837 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: action_args: {'id': '45c4d31f-74ba-4728-a36f-b0d7492c39c5'} Sep 03 03:49:07.614837 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:49:07.615482 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:49:07.615482 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 03 03:49:07.615482 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 03 03:49:07.615482 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 03 03:49:07.615482 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 03 03:49:07.615482 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 03 03:49:07.615482 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 03 03:49:07.615482 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 03 03:49:07.615482 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 03 03:49:07.615482 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 03 03:49:07.615482 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 03 03:49:07.615482 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 03:49:07.615482 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 03:49:07.615482 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 03:49:07.615482 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 03:49:07.615482 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 45c4d31f-74ba-4728-a36f-b0d7492c39c5 could not be found. (HTTP 404) (Request-ID: req-c33233e2-2d64-454f-95cb-fe3b064be9e8) Sep 03 03:49:07.615482 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:49:07.615482 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:49:07.615482 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:49:07.616597 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:49:07.616597 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 03 03:49:07.616597 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 03 03:49:07.616597 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 03 03:49:07.616597 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 03 03:49:07.616597 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 03 03:49:07.616597 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 03 03:49:07.616597 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 03 03:49:07.616597 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 03 03:49:07.616597 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 03 03:49:07.616597 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 03 03:49:07.616597 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 03 03:49:07.616597 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 03 03:49:07.616597 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 03 03:49:07.616597 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 03 03:49:07.616597 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 03 03:49:07.616597 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 03 03:49:07.616597 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 03 03:49:07.616597 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 03 03:49:07.617710 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 03:49:07.617710 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 03:49:07.617710 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 03:49:07.617710 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 03:49:07.617710 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 45c4d31f-74ba-4728-a36f-b0d7492c39c5 could not be found. Sep 03 03:49:07.617710 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:49:07.617710 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:49:07.617710 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:49:07.617710 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:49:07.617710 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:49:07.617710 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:49:07.617710 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:49:07.617710 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:49:07.617710 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 03:49:07.617710 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 03:49:07.617710 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:49:07.617710 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:49:07.617710 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 03 03:49:07.617710 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:49:07.618872 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 45c4d31f-74ba-4728-a36f-b0d7492c39c5 could not be found. Sep 03 03:49:07.618872 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:49:07.618872 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:49:07.618872 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:49:07.618872 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:49:07.618872 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:49:07.618872 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:49:07.618872 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:49:07.618872 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:49:07.618872 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 45c4d31f-74ba-4728-a36f-b0d7492c39c5 could not be found. Sep 03 03:49:07.618872 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:49:07.618872 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-491a33e2-5c08-4460-a52c-029115b3e862 tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] Returning 404 to user: Volume 45c4d31f-74ba-4728-a36f-b0d7492c39c5 could not be found. {{(pid=132076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:49:07.618872 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-491a33e2-5c08-4460-a52c-029115b3e862 tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/45c4d31f-74ba-4728-a36f-b0d7492c39c5" status: 404 len: 109 microversion: 2.1 time: 0.094369 Sep 03 03:49:07.625082 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-9d2db025-cab3-47ed-a678-212cbcf4e63b tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] Calling method '.version_select at 0x7f45fd475670>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:07.626953 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 13/24] 10.222.0.25 () {58 vars in 1248 bytes} [Sat Sep 3 03:49:07 2022] DELETE /compute/v2.1/os-volumes/45c4d31f-74ba-4728-a36f-b0d7492c39c5 => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 03:49:07.686794 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.wsgi [None req-9d2db025-cab3-47ed-a678-212cbcf4e63b tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] HTTP exception thrown: Volume 45c4d31f-74ba-4728-a36f-b0d7492c39c5 could not be found. Sep 03 03:49:07.688749 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-9d2db025-cab3-47ed-a678-212cbcf4e63b tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] Request method failure captured: Sep 03 03:49:07.688749 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: request: GET /compute/v2.1/os-volumes/45c4d31f-74ba-4728-a36f-b0d7492c39c5 HTTP/1.1 Sep 03 03:49:07.688749 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept: application/json Sep 03 03:49:07.688749 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept-Encoding: identity Sep 03 03:49:07.688749 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Connection: close Sep 03 03:49:07.688749 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Length: 0 Sep 03 03:49:07.688749 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Type: application/json Sep 03 03:49:07.688749 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Host: 10.222.0.25 Sep 03 03:49:07.688749 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Openstack-System-Scope: None Sep 03 03:49:07.688749 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: User-Agent: python-urllib3/1.26.12 Sep 03 03:49:07.688749 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Auth-Token: gAAAAABjEs6o6lydCjIRbwcnCufGsIXAGDktjz9kRNrSN3OZiEFo9NWBCOtddl2BebNRWNUBKS2EgQzyTa67CjMLDLEwKWPkIoGyCh3p4n_XBbJz_wcZ0ucGZ2DSiGsT-0vXZlRWelPWtip9vYOduvC6B1JwZ08cQL8fadRkyhQl-nKZzUdm9J0 Sep 03 03:49:07.688749 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Id: None Sep 03 03:49:07.688749 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Name: None Sep 03 03:49:07.688749 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Identity-Status: Confirmed Sep 03 03:49:07.688749 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Is-Admin-Project: True Sep 03 03:49:07.688749 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Id: default Sep 03 03:49:07.688749 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Name: Default Sep 03 03:49:07.688749 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Id: 5404143f5ac54f778c649bee74e51c13 Sep 03 03:49:07.688749 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-893015269 Sep 03 03:49:07.688749 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Role: member,reader Sep 03 03:49:07.688749 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Roles: member,reader Sep 03 03:49:07.689903 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5404143f5ac54f778c649bee74e51c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5404143f5ac54f778c649bee74e51c13"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5404143f5ac54f778c649bee74e51c13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5404143f5ac54f778c649bee74e51c13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:49:07.689903 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant: tempest-VolumesSnapshotsTestJSON-893015269 Sep 03 03:49:07.689903 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Id: 5404143f5ac54f778c649bee74e51c13 Sep 03 03:49:07.689903 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-893015269 Sep 03 03:49:07.689903 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User: tempest-VolumesSnapshotsTestJSON-893015269-project Sep 03 03:49:07.689903 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Id: default Sep 03 03:49:07.689903 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Name: Default Sep 03 03:49:07.689903 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Id: f4b3f2822726453a9f39e0b2bb76b5ef Sep 03 03:49:07.689903 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Name: tempest-VolumesSnapshotsTestJSON-893015269-project Sep 03 03:49:07.689903 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: method: Sep 03 03:49:07.689903 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: exception: Volume 45c4d31f-74ba-4728-a36f-b0d7492c39c5 could not be found. Sep 03 03:49:07.689903 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: action_args: {'id': '45c4d31f-74ba-4728-a36f-b0d7492c39c5'} Sep 03 03:49:07.689903 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:49:07.690701 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:49:07.690701 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 03 03:49:07.690701 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 03 03:49:07.690701 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 03 03:49:07.690701 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 03 03:49:07.690701 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 03 03:49:07.690701 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 03 03:49:07.690701 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 03 03:49:07.690701 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 03 03:49:07.690701 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 03 03:49:07.690701 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 03 03:49:07.690701 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 03:49:07.690701 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 03:49:07.690701 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 03:49:07.690701 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 03:49:07.690701 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 45c4d31f-74ba-4728-a36f-b0d7492c39c5 could not be found. (HTTP 404) (Request-ID: req-8b3743b4-77df-4611-9fa1-9f03b467ff19) Sep 03 03:49:07.690701 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:49:07.690701 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:49:07.690701 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:49:07.691771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:49:07.691771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 03 03:49:07.691771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 03 03:49:07.691771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 03 03:49:07.691771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 03 03:49:07.691771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 03 03:49:07.691771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 03 03:49:07.691771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 03 03:49:07.691771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 03 03:49:07.691771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 03 03:49:07.691771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 03 03:49:07.691771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 03 03:49:07.691771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 03 03:49:07.691771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 03 03:49:07.691771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 03 03:49:07.691771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 03 03:49:07.691771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 03 03:49:07.691771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 03 03:49:07.691771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 03 03:49:07.692747 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 03:49:07.692747 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 03:49:07.692747 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 03:49:07.692747 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 03:49:07.692747 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 45c4d31f-74ba-4728-a36f-b0d7492c39c5 could not be found. Sep 03 03:49:07.692747 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:49:07.692747 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:49:07.692747 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:49:07.692747 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:49:07.692747 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:49:07.692747 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:49:07.692747 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:49:07.692747 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:49:07.692747 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 03:49:07.692747 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 03:49:07.692747 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:49:07.692747 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:49:07.692747 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 03 03:49:07.692747 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:49:07.693781 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 45c4d31f-74ba-4728-a36f-b0d7492c39c5 could not be found. Sep 03 03:49:07.693781 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:49:07.693781 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:49:07.693781 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:49:07.693781 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:49:07.693781 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:49:07.693781 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:49:07.693781 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:49:07.693781 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:49:07.693781 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 45c4d31f-74ba-4728-a36f-b0d7492c39c5 could not be found. Sep 03 03:49:07.693781 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:49:07.695083 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-9d2db025-cab3-47ed-a678-212cbcf4e63b tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] Returning 404 to user: Volume 45c4d31f-74ba-4728-a36f-b0d7492c39c5 could not be found. {{(pid=132077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:49:07.696040 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-9d2db025-cab3-47ed-a678-212cbcf4e63b tempest-VolumesSnapshotsTestJSON-893015269 tempest-VolumesSnapshotsTestJSON-893015269-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/45c4d31f-74ba-4728-a36f-b0d7492c39c5" status: 404 len: 109 microversion: 2.1 time: 0.076492 Sep 03 03:49:07.696720 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 12/25] 10.222.0.25 () {58 vars in 1245 bytes} [Sat Sep 3 03:49:07 2022] GET /compute/v2.1/os-volumes/45c4d31f-74ba-4728-a36f-b0d7492c39c5 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 03:49:08.030161 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-96ae60c7-5664-4a22-b396-98a596b47f9c tempest-VolumesTestJSON-1300792509 tempest-VolumesTestJSON-1300792509-project] Calling method '.version_select at 0x7f45fd485ca0>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:08.151153 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-96ae60c7-5664-4a22-b396-98a596b47f9c tempest-VolumesTestJSON-1300792509 tempest-VolumesTestJSON-1300792509-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/4d730f86-ba5c-4ffb-b191-9c30768e51d5" status: 200 len: 350 microversion: 2.1 time: 0.124731 Sep 03 03:49:08.151798 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 14/26] 10.222.0.25 () {58 vars in 1245 bytes} [Sat Sep 3 03:49:08 2022] GET /compute/v2.1/os-volumes/4d730f86-ba5c-4ffb-b191-9c30768e51d5 => generated 350 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:49:09.924771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-26a6c44f-cc33-40b4-a9be-c49ed6978e2d tempest-VolumesTestJSON-1300792509 tempest-VolumesTestJSON-1300792509-project] Calling method '.version_select at 0x7f45fd489700>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:10.004790 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-26a6c44f-cc33-40b4-a9be-c49ed6978e2d tempest-VolumesTestJSON-1300792509 tempest-VolumesTestJSON-1300792509-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/4145b9f8-5b94-4965-9e4d-1111a5a56700" status: 200 len: 349 microversion: 2.1 time: 0.085127 Sep 03 03:49:10.013505 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 13/27] 10.222.0.25 () {58 vars in 1245 bytes} [Sat Sep 3 03:49:09 2022] GET /compute/v2.1/os-volumes/4145b9f8-5b94-4965-9e4d-1111a5a56700 => generated 349 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:49:11.730527 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-dda2f0df-98e5-435b-8013-2b17a0428b39 tempest-VolumesTestJSON-1300792509 tempest-VolumesTestJSON-1300792509-project] Calling method '.version_select at 0x7f45fd485f70>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:11.829458 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-dda2f0df-98e5-435b-8013-2b17a0428b39 tempest-VolumesTestJSON-1300792509 tempest-VolumesTestJSON-1300792509-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/a3e0b727-1bf6-47aa-be3e-17a2e6649b08" status: 200 len: 350 microversion: 2.1 time: 0.102801 Sep 03 03:49:11.830029 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 15/28] 10.222.0.25 () {58 vars in 1245 bytes} [Sat Sep 3 03:49:11 2022] GET /compute/v2.1/os-volumes/a3e0b727-1bf6-47aa-be3e-17a2e6649b08 => generated 350 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:49:11.843786 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-b0aa719c-a7ee-4625-8afc-cf81646581be tempest-VolumesTestJSON-1300792509 tempest-VolumesTestJSON-1300792509-project] Calling method '.version_select at 0x7f45fd489dc0>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:12.073184 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-b0aa719c-a7ee-4625-8afc-cf81646581be tempest-VolumesTestJSON-1300792509 tempest-VolumesTestJSON-1300792509-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.233230 Sep 03 03:49:12.090799 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-cfe76f4f-4f28-4fa2-84e6-c205ae0d1200 tempest-VolumesTestJSON-1300792509 tempest-VolumesTestJSON-1300792509-project] Calling method '.version_select at 0x7f45fd4853a0>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:12.091920 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 14/29] 10.222.0.25 () {58 vars in 1134 bytes} [Sat Sep 3 03:49:11 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:12.287193 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-cfe76f4f-4f28-4fa2-84e6-c205ae0d1200 tempest-VolumesTestJSON-1300792509 tempest-VolumesTestJSON-1300792509-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.201478 Sep 03 03:49:12.301624 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-c54ed373-f8f8-4946-a6cd-1ede040f2d8d tempest-VolumesTestJSON-1300792509 tempest-VolumesTestJSON-1300792509-project] Calling method '.version_select at 0x7f45fd475b80>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:12.302172 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 16/30] 10.222.0.25 () {58 vars in 1149 bytes} [Sat Sep 3 03:49:12 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:49:12.535488 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-c54ed373-f8f8-4946-a6cd-1ede040f2d8d tempest-VolumesTestJSON-1300792509 tempest-VolumesTestJSON-1300792509-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.237424 Sep 03 03:49:12.550317 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 15/31] 10.222.0.25 () {58 vars in 1134 bytes} [Sat Sep 3 03:49:12 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:12.551593 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-c2cc2815-1d6f-443d-9486-048d25527926 tempest-VolumesTestJSON-1300792509 tempest-VolumesTestJSON-1300792509-project] Calling method '.version_select at 0x7f45fd4961f0>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:12.778322 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-c2cc2815-1d6f-443d-9486-048d25527926 tempest-VolumesTestJSON-1300792509 tempest-VolumesTestJSON-1300792509-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.231956 Sep 03 03:49:12.792106 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 17/32] 10.222.0.25 () {58 vars in 1167 bytes} [Sat Sep 3 03:49:12 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:49:12.797095 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-d0d0f42b-3a82-49eb-961e-160932486d61 tempest-VolumesTestJSON-1300792509 tempest-VolumesTestJSON-1300792509-project] Calling method '.version_select at 0x7f45fd496af0>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:12.970561 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-d0d0f42b-3a82-49eb-961e-160932486d61 tempest-VolumesTestJSON-1300792509 tempest-VolumesTestJSON-1300792509-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.177131 Sep 03 03:49:12.971380 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 18/33] 10.222.0.25 () {58 vars in 1170 bytes} [Sat Sep 3 03:49:12 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:49:12.986174 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-7e34dc82-45da-4008-ad30-4bb029157b96 tempest-VolumesTestJSON-1300792509 tempest-VolumesTestJSON-1300792509-project] Calling method '.version_select at 0x7f45fd4a90d0>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:13.204374 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-7e34dc82-45da-4008-ad30-4bb029157b96 tempest-VolumesTestJSON-1300792509 tempest-VolumesTestJSON-1300792509-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.222797 Sep 03 03:49:13.204954 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 19/34] 10.222.0.25 () {58 vars in 1155 bytes} [Sat Sep 3 03:49:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:49:13.222754 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-de60317f-b02b-4c4d-a4ad-267b312d7764 tempest-VolumesTestJSON-1300792509 tempest-VolumesTestJSON-1300792509-project] Calling method '.version_select at 0x7f45fd485790>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:13.446993 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-c81a736d-0a59-4ce6-ab8f-f05d89ea45a9 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Action: 'create', calling method: .version_select at 0x7f45fd497af0>, body: {"keypair": {"name": "tempest-keypair-2086629987", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEw9ypUU9m3HrsLYL1OE6m9Z2AZi2FpYGnGcdm6mNO1qiYGZ9k99ag0U1slAigN2+rlsNgn+rLRnu4BDJnwdSUfXMMPw6NQMLec0yk5lSAwMo5BQ3lc0V5qR5PoHzmZEw=="}} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:49:13.456497 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-de60317f-b02b-4c4d-a4ad-267b312d7764 tempest-VolumesTestJSON-1300792509 tempest-VolumesTestJSON-1300792509-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.241817 Sep 03 03:49:13.457398 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 20/35] 10.222.0.25 () {58 vars in 1188 bytes} [Sat Sep 3 03:49:13 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:49:13.470510 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-c9c5d893-adb4-4825-b361-574711930212 tempest-VolumesTestJSON-1300792509 tempest-VolumesTestJSON-1300792509-project] Calling method '.version_select at 0x7f45fd485d30>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:13.670543 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.quota [None req-c81a736d-0a59-4ce6-ab8f-f05d89ea45a9 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Getting quotas for project 12347de4d2e5465b9a00004084fcb85c. Resources: {'key_pairs'} {{(pid=132077) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 03:49:13.682404 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.quota [None req-c81a736d-0a59-4ce6-ab8f-f05d89ea45a9 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Getting quotas for user 58361634962b4b7884d51be90b683b42 and project 12347de4d2e5465b9a00004084fcb85c. Resources: {'key_pairs'} {{(pid=132077) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 03:49:13.697090 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-c9c5d893-adb4-4825-b361-574711930212 tempest-VolumesTestJSON-1300792509 tempest-VolumesTestJSON-1300792509-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.230385 Sep 03 03:49:13.697959 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 21/36] 10.222.0.25 () {58 vars in 1155 bytes} [Sat Sep 3 03:49:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:49:13.761975 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-c81a736d-0a59-4ce6-ab8f-f05d89ea45a9 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.150826 Sep 03 03:49:13.763241 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 16/37] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Sep 3 03:49:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:49:13.867437 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-34d43ec2-7711-46af-9497-0e409f2578c3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Action: 'create', calling method: .version_select at 0x7f45fde678b0>, body: {"keypair": {"name": "tempest-keypair-858437405", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgg3gujJwXdIfQe/8h58j8Q7nLwnpb1IFm7+8JNbRKqgB7HNKIC9JtNMHcrD9OctklVCHZTTbVTYnqyQTj+95rWpWtjag1eCQasEBqXYnGNDmHx4QMm/qCk6j9k5kfW/Q=="}} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:49:14.038128 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.quota [None req-34d43ec2-7711-46af-9497-0e409f2578c3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Getting quotas for project ac9e77355ba040bda4f2186753df7b24. Resources: {'key_pairs'} {{(pid=132076) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 03:49:14.068443 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.quota [None req-34d43ec2-7711-46af-9497-0e409f2578c3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Getting quotas for user 1dde7fad075145c89f726ca85c6c00ba and project ac9e77355ba040bda4f2186753df7b24. Resources: {'key_pairs'} {{(pid=132076) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 03:49:14.211599 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-34d43ec2-7711-46af-9497-0e409f2578c3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.510605 Sep 03 03:49:14.212408 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 22/38] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Sep 3 03:49:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:49:15.203675 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-14149cea-4d44-4a89-8469-39dee94cf0f1 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1592331466", "imageRef": "0af209bb-870a-4343-a9f9-de05883bb8dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:49:15.393683 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.network.neutron [None req-14149cea-4d44-4a89-8469-39dee94cf0f1 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] validate_networks() for [('623f82bb-85e8-446e-8a72-4128e524e83a', None, None, None, None, None)] {{(pid=132077) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 03:49:16.783103 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-71f3b611-ae5b-4d69-ae7a-ec66e373252d tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-518297724", "imageRef": "0af209bb-870a-4343-a9f9-de05883bb8dd", "flavorRef": "452", "networks": [{"uuid": "419c559d-069c-43da-873e-5269227abec0"}]}} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:49:16.945968 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.network.neutron [None req-71f3b611-ae5b-4d69-ae7a-ec66e373252d tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] validate_networks() for [('419c559d-069c-43da-873e-5269227abec0', None, None, None, None, None)] {{(pid=132076) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 03:49:18.822287 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-14149cea-4d44-4a89-8469-39dee94cf0f1 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Flavor limits 0:0:0 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 03:49:18.822922 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-14149cea-4d44-4a89-8469-39dee94cf0f1 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Image limits 0:0:0 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 03:49:18.823416 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-14149cea-4d44-4a89-8469-39dee94cf0f1 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Flavor pref 0:0:0 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 03:49:18.823669 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-14149cea-4d44-4a89-8469-39dee94cf0f1 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Image pref 0:0:0 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 03:49:18.824086 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-14149cea-4d44-4a89-8469-39dee94cf0f1 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 03:49:18.856574 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-14149cea-4d44-4a89-8469-39dee94cf0f1 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:18.857365 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-14149cea-4d44-4a89-8469-39dee94cf0f1 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:18.861270 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-14149cea-4d44-4a89-8469-39dee94cf0f1 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:18.862281 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-14149cea-4d44-4a89-8469-39dee94cf0f1 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:18.864010 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-14149cea-4d44-4a89-8469-39dee94cf0f1 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:18.865638 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-14149cea-4d44-4a89-8469-39dee94cf0f1 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:18.962776 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.quota [None req-14149cea-4d44-4a89-8469-39dee94cf0f1 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Getting quotas for project f3077cfc588042e0a1becefe1363385c. Resources: {'ram', 'instances', 'cores'} {{(pid=132077) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 03:49:18.980933 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.quota [None req-14149cea-4d44-4a89-8469-39dee94cf0f1 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Getting quotas for user ba00478a6ef74115b83726083026f574 and project f3077cfc588042e0a1becefe1363385c. Resources: {'ram', 'instances', 'cores'} {{(pid=132077) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 03:49:19.053616 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-14149cea-4d44-4a89-8469-39dee94cf0f1 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Going to run 1 instances... {{(pid=132077) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 03:49:19.065425 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-14149cea-4d44-4a89-8469-39dee94cf0f1 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: f7f92467-64ec-4eba-af52-ad4923543504] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0af209bb-870a-4343-a9f9-de05883bb8dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132077) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 03:49:19.220967 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-14149cea-4d44-4a89-8469-39dee94cf0f1 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.658905 Sep 03 03:49:19.223926 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 17/39] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Sep 3 03:49:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 4662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 03:49:19.854163 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-bde9dfd7-2d8c-49ef-b06a-7a34ee9c4011 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Action: 'create', calling method: .version_select at 0x7f45fd3369d0>, body: {"keypair": {"name": "tempest-keypair-104258169", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcdoASMrVgpo/ZBqfxE/BoTUfclSs4woWTD7QN4e1hByFowJ6FjwpWErwJ0M7VPFGLWtd4lh1Xc3ta9jJrK6ctw5JV1Lk9mMCxyIEjbb6d6+wdGKDyotNnfOkdNoWJ0mQ=="}} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:49:19.914086 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.quota [None req-bde9dfd7-2d8c-49ef-b06a-7a34ee9c4011 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Getting quotas for project 4d80eadc5cc34322b85201c50b3c6552. Resources: {'key_pairs'} {{(pid=132077) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 03:49:19.931197 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.quota [None req-bde9dfd7-2d8c-49ef-b06a-7a34ee9c4011 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Getting quotas for user 31a8c62bd81f4c1f863bd952b6976276 and project 4d80eadc5cc34322b85201c50b3c6552. Resources: {'key_pairs'} {{(pid=132077) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 03:49:19.933080 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-71f3b611-ae5b-4d69-ae7a-ec66e373252d tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Flavor limits 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 03:49:19.933562 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-71f3b611-ae5b-4d69-ae7a-ec66e373252d tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Image limits 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 03:49:19.934104 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-71f3b611-ae5b-4d69-ae7a-ec66e373252d tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Flavor pref 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 03:49:19.934512 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-71f3b611-ae5b-4d69-ae7a-ec66e373252d tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Image pref 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 03:49:19.934953 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-71f3b611-ae5b-4d69-ae7a-ec66e373252d tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 03:49:19.960454 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-71f3b611-ae5b-4d69-ae7a-ec66e373252d tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:19.960955 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-71f3b611-ae5b-4d69-ae7a-ec66e373252d tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:19.968449 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-71f3b611-ae5b-4d69-ae7a-ec66e373252d tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:19.969284 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-71f3b611-ae5b-4d69-ae7a-ec66e373252d tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:19.969819 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-71f3b611-ae5b-4d69-ae7a-ec66e373252d tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:19.970317 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-71f3b611-ae5b-4d69-ae7a-ec66e373252d tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:20.020273 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-bde9dfd7-2d8c-49ef-b06a-7a34ee9c4011 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.790137 Sep 03 03:49:20.023234 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 18/40] 10.222.0.25 () {62 vars in 1200 bytes} [Sat Sep 3 03:49:19 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 798 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 03 03:49:20.046093 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-ee5883fb-d487-4ba0-b234-f695f6713ae8 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:20.049962 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-ee5883fb-d487-4ba0-b234-f695f6713ae8 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: f7f92467-64ec-4eba-af52-ad4923543504] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:20.071809 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.quota [None req-71f3b611-ae5b-4d69-ae7a-ec66e373252d tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Getting quotas for project 968cc9376f884f67b20b91547211fffd. Resources: {'ram', 'instances', 'cores'} {{(pid=132076) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 03:49:20.103234 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.quota [None req-71f3b611-ae5b-4d69-ae7a-ec66e373252d tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Getting quotas for user a959dec6c0c944aea231b65612892705 and project 968cc9376f884f67b20b91547211fffd. Resources: {'ram', 'instances', 'cores'} {{(pid=132076) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 03:49:20.136774 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-71f3b611-ae5b-4d69-ae7a-ec66e373252d tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Going to run 1 instances... {{(pid=132076) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 03:49:20.161097 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-71f3b611-ae5b-4d69-ae7a-ec66e373252d tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0af209bb-870a-4343-a9f9-de05883bb8dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132076) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 03:49:20.288895 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-71f3b611-ae5b-4d69-ae7a-ec66e373252d tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.314520 Sep 03 03:49:20.290195 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 23/41] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Sep 3 03:49:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 4316 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 03:49:20.303591 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-d1ffde0f-7ef2-4cfd-a3de-2901bc7aff9c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1049350915", "imageRef": "0af209bb-870a-4343-a9f9-de05883bb8dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "335e6c24-2920-465c-b2cd-3b3be68e2751"}], "security_groups": [{"name": "tempest-securitygroup--1905278030"}], "key_name": "tempest-keypair-2086629987", "user_data": "}} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:49:20.492068 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-ee5883fb-d487-4ba0-b234-f695f6713ae8 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:20.592267 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-ee5883fb-d487-4ba0-b234-f695f6713ae8 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504" status: 200 len: 1222 microversion: 2.1 time: 0.567502 Sep 03 03:49:20.592931 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 19/42] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:20 2022] GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504 => generated 1222 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:20.621241 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-371d6c02-2ac4-4e0e-9111-f30adffa51fa tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:20.621894 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-371d6c02-2ac4-4e0e-9111-f30adffa51fa tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:20.671809 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.network.neutron [None req-d1ffde0f-7ef2-4cfd-a3de-2901bc7aff9c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] validate_networks() for [('335e6c24-2920-465c-b2cd-3b3be68e2751', None, None, None, None, None)] {{(pid=132076) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 03:49:20.778140 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-371d6c02-2ac4-4e0e-9111-f30adffa51fa tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a959dec6c0c944aea231b65612892705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968cc9376f884f67b20b91547211fffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:20.792495 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-371d6c02-2ac4-4e0e-9111-f30adffa51fa tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 200 len: 1214 microversion: 2.1 time: 0.198435 Sep 03 03:49:20.793347 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 20/43] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:20 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 1214 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:20.849703 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-d80c1892-1c9d-4097-a18f-540ed93a35df tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-693561861", "imageRef": "0af209bb-870a-4343-a9f9-de05883bb8dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3310a324-39c6-4074-b839-e8b47e45dc07"}], "security_groups": [{"name": "tempest-securitygroup--574596704"}], "key_name": "tempest-keypair-858437405", "user_data": "}} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:49:21.247720 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.network.neutron [None req-d80c1892-1c9d-4097-a18f-540ed93a35df tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] validate_networks() for [('3310a324-39c6-4074-b839-e8b47e45dc07', None, None, None, None, None)] {{(pid=132077) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 03:49:22.103968 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-d1ffde0f-7ef2-4cfd-a3de-2901bc7aff9c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Flavor limits 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 03:49:22.105255 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-d1ffde0f-7ef2-4cfd-a3de-2901bc7aff9c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Image limits 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 03:49:22.105909 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-d1ffde0f-7ef2-4cfd-a3de-2901bc7aff9c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Flavor pref 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 03:49:22.106531 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-d1ffde0f-7ef2-4cfd-a3de-2901bc7aff9c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Image pref 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 03:49:22.107650 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-d1ffde0f-7ef2-4cfd-a3de-2901bc7aff9c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 03:49:22.130294 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d1ffde0f-7ef2-4cfd-a3de-2901bc7aff9c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:22.138653 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d1ffde0f-7ef2-4cfd-a3de-2901bc7aff9c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:22.139566 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d1ffde0f-7ef2-4cfd-a3de-2901bc7aff9c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:22.141303 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d1ffde0f-7ef2-4cfd-a3de-2901bc7aff9c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:22.148377 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d1ffde0f-7ef2-4cfd-a3de-2901bc7aff9c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:22.149115 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d1ffde0f-7ef2-4cfd-a3de-2901bc7aff9c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:22.183209 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.quota [None req-d1ffde0f-7ef2-4cfd-a3de-2901bc7aff9c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Getting quotas for project 12347de4d2e5465b9a00004084fcb85c. Resources: {'ram', 'instances', 'cores'} {{(pid=132076) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 03:49:22.188011 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.quota [None req-d1ffde0f-7ef2-4cfd-a3de-2901bc7aff9c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Getting quotas for user 58361634962b4b7884d51be90b683b42 and project 12347de4d2e5465b9a00004084fcb85c. Resources: {'ram', 'instances', 'cores'} {{(pid=132076) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 03:49:22.227952 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-d1ffde0f-7ef2-4cfd-a3de-2901bc7aff9c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Going to run 1 instances... {{(pid=132076) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 03:49:22.249504 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-d1ffde0f-7ef2-4cfd-a3de-2901bc7aff9c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0af209bb-870a-4343-a9f9-de05883bb8dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132076) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 03:49:22.445151 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-d1ffde0f-7ef2-4cfd-a3de-2901bc7aff9c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.153399 Sep 03 03:49:22.445836 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 24/44] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Sep 3 03:49:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 2155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 03:49:22.461237 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-629cc095-cf5a-4e41-948e-9789d3e99307 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-695557574", "imageRef": "0af209bb-870a-4343-a9f9-de05883bb8dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:49:22.586266 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-d80c1892-1c9d-4097-a18f-540ed93a35df tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Flavor limits 0:0:0 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 03:49:22.587091 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-d80c1892-1c9d-4097-a18f-540ed93a35df tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Image limits 0:0:0 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 03:49:22.587930 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.network.neutron [None req-629cc095-cf5a-4e41-948e-9789d3e99307 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] validate_networks() for [('623f82bb-85e8-446e-8a72-4128e524e83a', None, None, None, None, None)] {{(pid=132076) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 03:49:22.592132 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-d80c1892-1c9d-4097-a18f-540ed93a35df tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Flavor pref 0:0:0 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 03:49:22.592632 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-d80c1892-1c9d-4097-a18f-540ed93a35df tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Image pref 0:0:0 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 03:49:22.593064 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-d80c1892-1c9d-4097-a18f-540ed93a35df tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 03:49:22.623490 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d80c1892-1c9d-4097-a18f-540ed93a35df tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:22.624372 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d80c1892-1c9d-4097-a18f-540ed93a35df tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:22.626425 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d80c1892-1c9d-4097-a18f-540ed93a35df tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:22.630235 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d80c1892-1c9d-4097-a18f-540ed93a35df tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:22.631794 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d80c1892-1c9d-4097-a18f-540ed93a35df tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:22.633037 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d80c1892-1c9d-4097-a18f-540ed93a35df tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:22.680923 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.quota [None req-d80c1892-1c9d-4097-a18f-540ed93a35df tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Getting quotas for project ac9e77355ba040bda4f2186753df7b24. Resources: {'ram', 'instances', 'cores'} {{(pid=132077) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 03:49:22.689418 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.quota [None req-d80c1892-1c9d-4097-a18f-540ed93a35df tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Getting quotas for user 1dde7fad075145c89f726ca85c6c00ba and project ac9e77355ba040bda4f2186753df7b24. Resources: {'ram', 'instances', 'cores'} {{(pid=132077) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 03:49:22.721778 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-d80c1892-1c9d-4097-a18f-540ed93a35df tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Going to run 1 instances... {{(pid=132077) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 03:49:22.724030 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-d80c1892-1c9d-4097-a18f-540ed93a35df tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0af209bb-870a-4343-a9f9-de05883bb8dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132077) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 03:49:22.813122 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-d80c1892-1c9d-4097-a18f-540ed93a35df tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.968299 Sep 03 03:49:22.829887 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 21/45] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Sep 3 03:49:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 1975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 03 03:49:22.840525 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-92335fd9-b429-4483-867b-5df56d678cc6 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:22.841153 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-92335fd9-b429-4483-867b-5df56d678cc6 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:22.857287 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-92335fd9-b429-4483-867b-5df56d678cc6 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:22.857804 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-92335fd9-b429-4483-867b-5df56d678cc6 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:22.858243 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-92335fd9-b429-4483-867b-5df56d678cc6 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:22.860891 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-92335fd9-b429-4483-867b-5df56d678cc6 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:22.861427 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-92335fd9-b429-4483-867b-5df56d678cc6 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:22.861953 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-92335fd9-b429-4483-867b-5df56d678cc6 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:23.820879 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-92335fd9-b429-4483-867b-5df56d678cc6 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a959dec6c0c944aea231b65612892705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968cc9376f884f67b20b91547211fffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:23.842685 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-92335fd9-b429-4483-867b-5df56d678cc6 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 200 len: 1218 microversion: 2.1 time: 1.010252 Sep 03 03:49:23.850850 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 22/46] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:22 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 1218 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:23.856234 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-c0b1a873-9882-4fbf-a17f-859500d581c0 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:23.857340 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-c0b1a873-9882-4fbf-a17f-859500d581c0 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:24.159922 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-629cc095-cf5a-4e41-948e-9789d3e99307 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Flavor limits 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 03:49:24.160704 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-629cc095-cf5a-4e41-948e-9789d3e99307 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Image limits 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 03:49:24.162109 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-629cc095-cf5a-4e41-948e-9789d3e99307 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Flavor pref 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 03:49:24.162637 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-629cc095-cf5a-4e41-948e-9789d3e99307 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Image pref 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 03:49:24.163436 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-629cc095-cf5a-4e41-948e-9789d3e99307 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 03:49:24.177084 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-629cc095-cf5a-4e41-948e-9789d3e99307 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:24.177698 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-629cc095-cf5a-4e41-948e-9789d3e99307 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:24.178255 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-629cc095-cf5a-4e41-948e-9789d3e99307 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:24.179129 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-629cc095-cf5a-4e41-948e-9789d3e99307 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:24.179677 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-629cc095-cf5a-4e41-948e-9789d3e99307 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:24.180733 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-629cc095-cf5a-4e41-948e-9789d3e99307 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:24.205338 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.quota [None req-629cc095-cf5a-4e41-948e-9789d3e99307 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Getting quotas for project f3077cfc588042e0a1becefe1363385c. Resources: {'ram', 'instances', 'cores'} {{(pid=132076) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 03:49:24.211237 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.quota [None req-629cc095-cf5a-4e41-948e-9789d3e99307 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Getting quotas for user ba00478a6ef74115b83726083026f574 and project f3077cfc588042e0a1becefe1363385c. Resources: {'ram', 'instances', 'cores'} {{(pid=132076) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 03:49:24.225932 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-629cc095-cf5a-4e41-948e-9789d3e99307 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Going to run 1 instances... {{(pid=132076) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 03:49:24.228548 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-629cc095-cf5a-4e41-948e-9789d3e99307 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0af209bb-870a-4343-a9f9-de05883bb8dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132076) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 03:49:24.325288 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-629cc095-cf5a-4e41-948e-9789d3e99307 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.870142 Sep 03 03:49:24.333237 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 25/47] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Sep 3 03:49:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 1879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 03:49:24.368072 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-14b68947-04dd-4537-aeea-df94297a2a5e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:24.383915 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-14b68947-04dd-4537-aeea-df94297a2a5e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:24.418998 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-14b68947-04dd-4537-aeea-df94297a2a5e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:24.419784 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-14b68947-04dd-4537-aeea-df94297a2a5e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:24.443995 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-14b68947-04dd-4537-aeea-df94297a2a5e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:24.447207 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-14b68947-04dd-4537-aeea-df94297a2a5e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:24.448766 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-14b68947-04dd-4537-aeea-df94297a2a5e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:24.449418 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-14b68947-04dd-4537-aeea-df94297a2a5e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:24.804078 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-c0b1a873-9882-4fbf-a17f-859500d581c0 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:24.821997 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-c0b1a873-9882-4fbf-a17f-859500d581c0 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1238 microversion: 2.1 time: 0.969417 Sep 03 03:49:24.841003 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 23/48] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:23 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1238 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:24.853469 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-416f7a55-d51a-4926-91de-bafb68d1ddb0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:24.854337 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-416f7a55-d51a-4926-91de-bafb68d1ddb0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:24.958938 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-14b68947-04dd-4537-aeea-df94297a2a5e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:25.011621 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-14b68947-04dd-4537-aeea-df94297a2a5e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911" status: 200 len: 1236 microversion: 2.1 time: 0.661658 Sep 03 03:49:25.012395 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 26/49] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:24 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 => generated 1236 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:25.055124 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-7a238328-2046-4a7b-9704-054b55605ab1 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:25.057157 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-7a238328-2046-4a7b-9704-054b55605ab1 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:25.093794 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-416f7a55-d51a-4926-91de-bafb68d1ddb0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:25.102660 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7a238328-2046-4a7b-9704-054b55605ab1 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:25.105065 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7a238328-2046-4a7b-9704-054b55605ab1 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:25.115371 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7a238328-2046-4a7b-9704-054b55605ab1 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:25.115767 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-416f7a55-d51a-4926-91de-bafb68d1ddb0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1221 microversion: 2.1 time: 0.268258 Sep 03 03:49:25.118655 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7a238328-2046-4a7b-9704-054b55605ab1 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:25.122026 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7a238328-2046-4a7b-9704-054b55605ab1 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:25.125902 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7a238328-2046-4a7b-9704-054b55605ab1 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:25.127448 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 24/50] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:24 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1221 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:25.630552 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-7a238328-2046-4a7b-9704-054b55605ab1 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a959dec6c0c944aea231b65612892705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968cc9376f884f67b20b91547211fffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:25.640222 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-7a238328-2046-4a7b-9704-054b55605ab1 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 200 len: 1274 microversion: 2.1 time: 0.622544 Sep 03 03:49:25.640817 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 27/51] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:25 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 1274 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:25.846220 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-de5259d5-f316-4d82-a931-59f8fb7f0774 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:25.847715 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-de5259d5-f316-4d82-a931-59f8fb7f0774 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:25.873266 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-de5259d5-f316-4d82-a931-59f8fb7f0774 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:25.873266 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-de5259d5-f316-4d82-a931-59f8fb7f0774 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:25.873266 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-de5259d5-f316-4d82-a931-59f8fb7f0774 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:25.875232 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-de5259d5-f316-4d82-a931-59f8fb7f0774 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:25.879615 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-de5259d5-f316-4d82-a931-59f8fb7f0774 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:25.885343 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-de5259d5-f316-4d82-a931-59f8fb7f0774 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:26.043178 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-2aef9616-8760-48f7-8516-216f19100f92 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:26.044099 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-2aef9616-8760-48f7-8516-216f19100f92 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:26.065079 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2aef9616-8760-48f7-8516-216f19100f92 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:26.065740 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2aef9616-8760-48f7-8516-216f19100f92 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:26.067908 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2aef9616-8760-48f7-8516-216f19100f92 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:26.068691 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2aef9616-8760-48f7-8516-216f19100f92 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:26.069196 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2aef9616-8760-48f7-8516-216f19100f92 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:26.069629 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2aef9616-8760-48f7-8516-216f19100f92 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:26.282533 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-de5259d5-f316-4d82-a931-59f8fb7f0774 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:26.293172 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-de5259d5-f316-4d82-a931-59f8fb7f0774 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1298 microversion: 2.1 time: 0.452231 Sep 03 03:49:26.318944 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 25/52] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:25 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1298 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:26.324381 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-1aaf44cb-0262-4cad-84f7-dafb90ad3a29 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:26.324998 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-1aaf44cb-0262-4cad-84f7-dafb90ad3a29 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:26.379015 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1aaf44cb-0262-4cad-84f7-dafb90ad3a29 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:26.379546 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1aaf44cb-0262-4cad-84f7-dafb90ad3a29 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:26.379995 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1aaf44cb-0262-4cad-84f7-dafb90ad3a29 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:26.380724 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1aaf44cb-0262-4cad-84f7-dafb90ad3a29 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:26.401339 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1aaf44cb-0262-4cad-84f7-dafb90ad3a29 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:26.401843 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1aaf44cb-0262-4cad-84f7-dafb90ad3a29 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:26.806977 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-1aaf44cb-0262-4cad-84f7-dafb90ad3a29 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:26.821115 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-1aaf44cb-0262-4cad-84f7-dafb90ad3a29 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1217 microversion: 2.1 time: 0.499264 Sep 03 03:49:26.845949 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 26/53] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:26 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1217 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:26.852798 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-2aef9616-8760-48f7-8516-216f19100f92 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:26.863817 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-5d4fd0cd-e387-475b-a6e0-1c8febc2bad6 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:26.865093 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-5d4fd0cd-e387-475b-a6e0-1c8febc2bad6 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:26.871131 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-2aef9616-8760-48f7-8516-216f19100f92 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911" status: 200 len: 1292 microversion: 2.1 time: 0.825072 Sep 03 03:49:26.871888 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 28/54] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:26 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 => generated 1292 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:49:26.884260 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5d4fd0cd-e387-475b-a6e0-1c8febc2bad6 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:26.888360 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5d4fd0cd-e387-475b-a6e0-1c8febc2bad6 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:26.889067 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5d4fd0cd-e387-475b-a6e0-1c8febc2bad6 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:26.893255 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5d4fd0cd-e387-475b-a6e0-1c8febc2bad6 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:26.894057 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5d4fd0cd-e387-475b-a6e0-1c8febc2bad6 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:26.895313 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5d4fd0cd-e387-475b-a6e0-1c8febc2bad6 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:27.288546 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-5d4fd0cd-e387-475b-a6e0-1c8febc2bad6 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a959dec6c0c944aea231b65612892705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968cc9376f884f67b20b91547211fffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:27.302345 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-5d4fd0cd-e387-475b-a6e0-1c8febc2bad6 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 200 len: 1272 microversion: 2.1 time: 0.453075 Sep 03 03:49:27.303606 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 27/55] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:26 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 1272 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:27.333775 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-9832e1e4-6fb5-42ad-b9d6-3d5b08f88559 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:27.334767 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-9832e1e4-6fb5-42ad-b9d6-3d5b08f88559 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:27.346668 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9832e1e4-6fb5-42ad-b9d6-3d5b08f88559 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:27.347550 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9832e1e4-6fb5-42ad-b9d6-3d5b08f88559 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:27.348364 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9832e1e4-6fb5-42ad-b9d6-3d5b08f88559 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:27.349315 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9832e1e4-6fb5-42ad-b9d6-3d5b08f88559 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:27.351599 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9832e1e4-6fb5-42ad-b9d6-3d5b08f88559 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:27.356036 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9832e1e4-6fb5-42ad-b9d6-3d5b08f88559 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:27.643224 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-9832e1e4-6fb5-42ad-b9d6-3d5b08f88559 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:27.676349 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-9832e1e4-6fb5-42ad-b9d6-3d5b08f88559 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1296 microversion: 2.1 time: 0.351295 Sep 03 03:49:27.677000 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 29/56] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:27 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1296 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:27.849934 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-77c9a665-32d5-4e32-bc38-c78486c7de17 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:27.851238 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-77c9a665-32d5-4e32-bc38-c78486c7de17 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:27.874508 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-77c9a665-32d5-4e32-bc38-c78486c7de17 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:27.903856 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-f2631f55-fcdf-4540-8b69-e77f18e3892d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:27.904765 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-f2631f55-fcdf-4540-8b69-e77f18e3892d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:27.907517 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-77c9a665-32d5-4e32-bc38-c78486c7de17 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:27.910080 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-77c9a665-32d5-4e32-bc38-c78486c7de17 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:27.917467 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-77c9a665-32d5-4e32-bc38-c78486c7de17 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:27.919694 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-77c9a665-32d5-4e32-bc38-c78486c7de17 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:27.921565 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-77c9a665-32d5-4e32-bc38-c78486c7de17 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:27.925647 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f2631f55-fcdf-4540-8b69-e77f18e3892d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:27.926187 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f2631f55-fcdf-4540-8b69-e77f18e3892d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:27.926625 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f2631f55-fcdf-4540-8b69-e77f18e3892d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:27.937802 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f2631f55-fcdf-4540-8b69-e77f18e3892d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:27.941859 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f2631f55-fcdf-4540-8b69-e77f18e3892d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:27.947273 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f2631f55-fcdf-4540-8b69-e77f18e3892d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:28.312195 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-77c9a665-32d5-4e32-bc38-c78486c7de17 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:28.321058 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-77c9a665-32d5-4e32-bc38-c78486c7de17 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1273 microversion: 2.1 time: 0.477386 Sep 03 03:49:28.327430 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 28/57] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:27 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1273 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:28.337520 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-5c07a4fc-4cbd-43de-9b07-f22eb79af35b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1354962057", "imageRef": "0af209bb-870a-4343-a9f9-de05883bb8dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a31ab79a-5d78-4441-9a2d-dcb13a26f9be"}], "security_groups": [{"name": "tempest-securitygroup--1649370848"}], "key_name": "tempest-keypair-104258169", "user_data": "}} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:49:28.404394 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-f2631f55-fcdf-4540-8b69-e77f18e3892d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:28.418614 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-f2631f55-fcdf-4540-8b69-e77f18e3892d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911" status: 200 len: 1298 microversion: 2.1 time: 0.519696 Sep 03 03:49:28.425412 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 30/58] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:27 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 => generated 1298 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:28.461335 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-2fea17e1-1654-4fc7-9983-6d97182dc904 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:28.466367 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-2fea17e1-1654-4fc7-9983-6d97182dc904 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:28.504376 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2fea17e1-1654-4fc7-9983-6d97182dc904 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:28.509231 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2fea17e1-1654-4fc7-9983-6d97182dc904 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:28.512654 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2fea17e1-1654-4fc7-9983-6d97182dc904 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:28.521358 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2fea17e1-1654-4fc7-9983-6d97182dc904 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:28.524239 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2fea17e1-1654-4fc7-9983-6d97182dc904 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:28.528503 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2fea17e1-1654-4fc7-9983-6d97182dc904 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:29.252842 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-2fea17e1-1654-4fc7-9983-6d97182dc904 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a959dec6c0c944aea231b65612892705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968cc9376f884f67b20b91547211fffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:29.281954 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-2fea17e1-1654-4fc7-9983-6d97182dc904 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 200 len: 1272 microversion: 2.1 time: 0.853790 Sep 03 03:49:29.283896 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 31/59] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:28 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 1272 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:29.306046 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-96342959-771c-4a8a-b629-11e22a9ed90b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:29.309206 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-96342959-771c-4a8a-b629-11e22a9ed90b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:29.322327 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-96342959-771c-4a8a-b629-11e22a9ed90b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:29.323554 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-96342959-771c-4a8a-b629-11e22a9ed90b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:29.329000 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-96342959-771c-4a8a-b629-11e22a9ed90b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:29.330376 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-96342959-771c-4a8a-b629-11e22a9ed90b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:29.331164 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-96342959-771c-4a8a-b629-11e22a9ed90b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:29.331921 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-96342959-771c-4a8a-b629-11e22a9ed90b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:29.393305 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.network.neutron [None req-5c07a4fc-4cbd-43de-9b07-f22eb79af35b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] validate_networks() for [('a31ab79a-5d78-4441-9a2d-dcb13a26f9be', None, None, None, None, None)] {{(pid=132077) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 03:49:29.559260 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-96342959-771c-4a8a-b629-11e22a9ed90b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:29.598639 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-96342959-771c-4a8a-b629-11e22a9ed90b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1296 microversion: 2.1 time: 0.288916 Sep 03 03:49:29.601204 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 32/60] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:29 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1296 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:29.615295 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-77f169e2-d867-496e-82d0-e4e7c5ebc0d9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:29.617122 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-77f169e2-d867-496e-82d0-e4e7c5ebc0d9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:29.637194 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-77f169e2-d867-496e-82d0-e4e7c5ebc0d9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:29.637194 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-77f169e2-d867-496e-82d0-e4e7c5ebc0d9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:29.639128 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-77f169e2-d867-496e-82d0-e4e7c5ebc0d9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:29.640643 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-77f169e2-d867-496e-82d0-e4e7c5ebc0d9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:29.641842 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-77f169e2-d867-496e-82d0-e4e7c5ebc0d9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:29.643502 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-77f169e2-d867-496e-82d0-e4e7c5ebc0d9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:29.886982 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-77f169e2-d867-496e-82d0-e4e7c5ebc0d9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:29.903442 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-77f169e2-d867-496e-82d0-e4e7c5ebc0d9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1279 microversion: 2.1 time: 0.297915 Sep 03 03:49:29.910903 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 33/61] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:29 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1279 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:29.919476 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-cecf4543-e590-4db7-8f08-1447058518e3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:29.921734 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-cecf4543-e590-4db7-8f08-1447058518e3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:29.941559 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cecf4543-e590-4db7-8f08-1447058518e3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:29.951560 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cecf4543-e590-4db7-8f08-1447058518e3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:29.952235 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cecf4543-e590-4db7-8f08-1447058518e3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:29.953035 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cecf4543-e590-4db7-8f08-1447058518e3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:29.953497 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cecf4543-e590-4db7-8f08-1447058518e3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:29.953950 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cecf4543-e590-4db7-8f08-1447058518e3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:30.283787 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-cecf4543-e590-4db7-8f08-1447058518e3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:30.295471 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-cecf4543-e590-4db7-8f08-1447058518e3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911" status: 200 len: 1298 microversion: 2.1 time: 0.387248 Sep 03 03:49:30.302866 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 34/62] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:29 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 => generated 1298 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:30.317999 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-fe37ec67-5890-42fa-90ce-fa8b42d3ab79 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:30.319064 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-fe37ec67-5890-42fa-90ce-fa8b42d3ab79 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:30.328162 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fe37ec67-5890-42fa-90ce-fa8b42d3ab79 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:30.336288 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fe37ec67-5890-42fa-90ce-fa8b42d3ab79 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:30.337018 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fe37ec67-5890-42fa-90ce-fa8b42d3ab79 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:30.338038 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fe37ec67-5890-42fa-90ce-fa8b42d3ab79 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:30.338653 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fe37ec67-5890-42fa-90ce-fa8b42d3ab79 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:30.339236 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fe37ec67-5890-42fa-90ce-fa8b42d3ab79 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:31.098762 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-fe37ec67-5890-42fa-90ce-fa8b42d3ab79 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a959dec6c0c944aea231b65612892705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968cc9376f884f67b20b91547211fffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:31.109717 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-fe37ec67-5890-42fa-90ce-fa8b42d3ab79 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 200 len: 1314 microversion: 2.1 time: 0.804136 Sep 03 03:49:31.114599 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 35/63] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:30 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 1314 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:31.135460 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-14af39c1-5320-45dc-98c6-7c0aa78f9e25 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:31.136397 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-14af39c1-5320-45dc-98c6-7c0aa78f9e25 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:31.145033 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-14af39c1-5320-45dc-98c6-7c0aa78f9e25 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:31.145672 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-14af39c1-5320-45dc-98c6-7c0aa78f9e25 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:31.146203 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-14af39c1-5320-45dc-98c6-7c0aa78f9e25 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:31.147075 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-14af39c1-5320-45dc-98c6-7c0aa78f9e25 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:31.147657 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-14af39c1-5320-45dc-98c6-7c0aa78f9e25 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:31.148150 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-14af39c1-5320-45dc-98c6-7c0aa78f9e25 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:31.284839 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-14af39c1-5320-45dc-98c6-7c0aa78f9e25 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:31.293756 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-14af39c1-5320-45dc-98c6-7c0aa78f9e25 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1296 microversion: 2.1 time: 0.177735 Sep 03 03:49:31.294610 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 36/64] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:31 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1296 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:31.301149 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-be92c70a-2331-4490-8015-734c74a850cf tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:31.302027 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-be92c70a-2331-4490-8015-734c74a850cf tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:31.308641 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-be92c70a-2331-4490-8015-734c74a850cf tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:31.309321 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-be92c70a-2331-4490-8015-734c74a850cf tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:31.309924 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-be92c70a-2331-4490-8015-734c74a850cf tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:31.310774 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-be92c70a-2331-4490-8015-734c74a850cf tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:31.311590 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-be92c70a-2331-4490-8015-734c74a850cf tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:31.312156 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-be92c70a-2331-4490-8015-734c74a850cf tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:31.396884 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-be92c70a-2331-4490-8015-734c74a850cf tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:31.408939 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-be92c70a-2331-4490-8015-734c74a850cf tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1279 microversion: 2.1 time: 0.112204 Sep 03 03:49:31.411664 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 37/65] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:31 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1279 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:31.425302 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-4eb08b55-3702-4c9c-9b7d-72bfdb6212a6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:31.425949 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-4eb08b55-3702-4c9c-9b7d-72bfdb6212a6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:31.442423 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4eb08b55-3702-4c9c-9b7d-72bfdb6212a6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:31.442961 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4eb08b55-3702-4c9c-9b7d-72bfdb6212a6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:31.443404 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4eb08b55-3702-4c9c-9b7d-72bfdb6212a6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:31.444178 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4eb08b55-3702-4c9c-9b7d-72bfdb6212a6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:31.444985 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4eb08b55-3702-4c9c-9b7d-72bfdb6212a6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:31.447839 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4eb08b55-3702-4c9c-9b7d-72bfdb6212a6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:31.931307 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-5c07a4fc-4cbd-43de-9b07-f22eb79af35b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Flavor limits 0:0:0 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 03:49:31.931799 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-5c07a4fc-4cbd-43de-9b07-f22eb79af35b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Image limits 0:0:0 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 03:49:31.932192 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-5c07a4fc-4cbd-43de-9b07-f22eb79af35b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Flavor pref 0:0:0 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 03:49:31.932365 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-4eb08b55-3702-4c9c-9b7d-72bfdb6212a6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:31.932599 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-5c07a4fc-4cbd-43de-9b07-f22eb79af35b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Image pref 0:0:0 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 03:49:31.933296 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-5c07a4fc-4cbd-43de-9b07-f22eb79af35b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 03:49:31.940967 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-4eb08b55-3702-4c9c-9b7d-72bfdb6212a6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911" status: 200 len: 1298 microversion: 2.1 time: 0.527017 Sep 03 03:49:31.943262 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 38/66] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:31 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 => generated 1298 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:31.948247 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5c07a4fc-4cbd-43de-9b07-f22eb79af35b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:31.948879 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5c07a4fc-4cbd-43de-9b07-f22eb79af35b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:31.949451 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5c07a4fc-4cbd-43de-9b07-f22eb79af35b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:31.950309 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5c07a4fc-4cbd-43de-9b07-f22eb79af35b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:31.951135 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5c07a4fc-4cbd-43de-9b07-f22eb79af35b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:31.951716 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5c07a4fc-4cbd-43de-9b07-f22eb79af35b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:31.973787 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.quota [None req-5c07a4fc-4cbd-43de-9b07-f22eb79af35b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Getting quotas for project 4d80eadc5cc34322b85201c50b3c6552. Resources: {'ram', 'instances', 'cores'} {{(pid=132077) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 03:49:31.978208 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.quota [None req-5c07a4fc-4cbd-43de-9b07-f22eb79af35b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Getting quotas for user 31a8c62bd81f4c1f863bd952b6976276 and project 4d80eadc5cc34322b85201c50b3c6552. Resources: {'ram', 'instances', 'cores'} {{(pid=132077) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 03:49:31.992246 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-5c07a4fc-4cbd-43de-9b07-f22eb79af35b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Going to run 1 instances... {{(pid=132077) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 03:49:31.994768 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-5c07a4fc-4cbd-43de-9b07-f22eb79af35b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0af209bb-870a-4343-a9f9-de05883bb8dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132077) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 03:49:32.011077 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:32.064990 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-5c07a4fc-4cbd-43de-9b07-f22eb79af35b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.735669 Sep 03 03:49:32.066516 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 29/67] 10.222.0.25 () {62 vars in 1188 bytes} [Sat Sep 3 03:49:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 3738 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 03 03:49:32.077957 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-7c028b09-25a4-4ffb-8482-691a05c2c612 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:32.078684 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-7c028b09-25a4-4ffb-8482-691a05c2c612 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:32.149378 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-752929a9-c6de-4f53-8471-40ca6558f9c0 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:32.150961 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-752929a9-c6de-4f53-8471-40ca6558f9c0 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:32.185955 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-752929a9-c6de-4f53-8471-40ca6558f9c0 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:32.186527 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-752929a9-c6de-4f53-8471-40ca6558f9c0 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:32.187950 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-752929a9-c6de-4f53-8471-40ca6558f9c0 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:32.189426 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-752929a9-c6de-4f53-8471-40ca6558f9c0 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:32.189892 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-752929a9-c6de-4f53-8471-40ca6558f9c0 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:32.190313 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-752929a9-c6de-4f53-8471-40ca6558f9c0 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:32.236927 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-7c028b09-25a4-4ffb-8482-691a05c2c612 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:32.263628 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-7c028b09-25a4-4ffb-8482-691a05c2c612 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:32.277458 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-7c028b09-25a4-4ffb-8482-691a05c2c612 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:32.278616 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-7c028b09-25a4-4ffb-8482-691a05c2c612 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1281 microversion: 2.20 time: 0.205076 Sep 03 03:49:32.283337 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 39/68] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:49:32 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1281 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:49:32.318918 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-206211e2-ad76-46f1-8b22-500352bad4d1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:32.320357 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-206211e2-ad76-46f1-8b22-500352bad4d1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:32.330434 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-206211e2-ad76-46f1-8b22-500352bad4d1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:32.331450 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-206211e2-ad76-46f1-8b22-500352bad4d1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:32.334924 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-206211e2-ad76-46f1-8b22-500352bad4d1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:32.337862 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-206211e2-ad76-46f1-8b22-500352bad4d1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:32.338730 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-206211e2-ad76-46f1-8b22-500352bad4d1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:32.339398 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-206211e2-ad76-46f1-8b22-500352bad4d1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:32.517204 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-752929a9-c6de-4f53-8471-40ca6558f9c0 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a959dec6c0c944aea231b65612892705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968cc9376f884f67b20b91547211fffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:32.532802 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-752929a9-c6de-4f53-8471-40ca6558f9c0 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 200 len: 1314 microversion: 2.1 time: 0.388904 Sep 03 03:49:32.534343 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 30/69] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:32 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:32.540060 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-6aa54775-ee09-4804-a27e-0caa085817c2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:32.541050 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-6aa54775-ee09-4804-a27e-0caa085817c2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:32.548924 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6aa54775-ee09-4804-a27e-0caa085817c2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:32.549810 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6aa54775-ee09-4804-a27e-0caa085817c2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:32.550893 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6aa54775-ee09-4804-a27e-0caa085817c2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:32.551915 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6aa54775-ee09-4804-a27e-0caa085817c2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:32.552776 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6aa54775-ee09-4804-a27e-0caa085817c2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:32.553334 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6aa54775-ee09-4804-a27e-0caa085817c2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:32.636772 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-6aa54775-ee09-4804-a27e-0caa085817c2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:32.645206 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-6aa54775-ee09-4804-a27e-0caa085817c2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1279 microversion: 2.1 time: 0.109472 Sep 03 03:49:32.646096 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 31/70] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:32 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1279 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:32.706343 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-206211e2-ad76-46f1-8b22-500352bad4d1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:32.721239 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-206211e2-ad76-46f1-8b22-500352bad4d1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1364 microversion: 2.1 time: 0.407457 Sep 03 03:49:32.722235 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 40/71] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:32 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1364 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:49:32.967713 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-03afb2cc-672d-4823-8ea0-bca50707a7a4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:32.969044 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-03afb2cc-672d-4823-8ea0-bca50707a7a4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:32.984126 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-03afb2cc-672d-4823-8ea0-bca50707a7a4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:32.984713 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-03afb2cc-672d-4823-8ea0-bca50707a7a4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:32.985143 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-03afb2cc-672d-4823-8ea0-bca50707a7a4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:32.985864 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-03afb2cc-672d-4823-8ea0-bca50707a7a4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:32.986320 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-03afb2cc-672d-4823-8ea0-bca50707a7a4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:32.986716 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-03afb2cc-672d-4823-8ea0-bca50707a7a4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:33.126546 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-03afb2cc-672d-4823-8ea0-bca50707a7a4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:33.135245 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-03afb2cc-672d-4823-8ea0-bca50707a7a4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911" status: 200 len: 1365 microversion: 2.1 time: 0.171158 Sep 03 03:49:33.135814 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 32/72] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:32 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:49:33.307092 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-14d6b9a3-6790-46cd-a4e2-c8ad2f85eb99 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:33.307612 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-14d6b9a3-6790-46cd-a4e2-c8ad2f85eb99 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:33.313674 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-14d6b9a3-6790-46cd-a4e2-c8ad2f85eb99 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:33.314148 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-14d6b9a3-6790-46cd-a4e2-c8ad2f85eb99 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:33.314566 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-14d6b9a3-6790-46cd-a4e2-c8ad2f85eb99 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:33.315272 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-14d6b9a3-6790-46cd-a4e2-c8ad2f85eb99 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:33.315910 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-14d6b9a3-6790-46cd-a4e2-c8ad2f85eb99 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:33.316321 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-14d6b9a3-6790-46cd-a4e2-c8ad2f85eb99 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:33.383348 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-14d6b9a3-6790-46cd-a4e2-c8ad2f85eb99 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:33.392520 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-14d6b9a3-6790-46cd-a4e2-c8ad2f85eb99 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:33.394676 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-14d6b9a3-6790-46cd-a4e2-c8ad2f85eb99 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:33.396104 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-14d6b9a3-6790-46cd-a4e2-c8ad2f85eb99 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1285 microversion: 2.20 time: 0.092996 Sep 03 03:49:33.411394 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 41/73] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:49:33 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:49:33.562008 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-a9dda13c-0d18-4573-a34f-2944da8e0245 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:33.562607 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-a9dda13c-0d18-4573-a34f-2944da8e0245 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:33.575224 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a9dda13c-0d18-4573-a34f-2944da8e0245 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:33.576034 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a9dda13c-0d18-4573-a34f-2944da8e0245 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:33.577340 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a9dda13c-0d18-4573-a34f-2944da8e0245 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:33.578740 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a9dda13c-0d18-4573-a34f-2944da8e0245 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:33.580602 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a9dda13c-0d18-4573-a34f-2944da8e0245 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:33.582346 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a9dda13c-0d18-4573-a34f-2944da8e0245 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:33.670691 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-0e6a0875-3d69-4164-9b53-a5776b1dbb7a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:33.671578 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-0e6a0875-3d69-4164-9b53-a5776b1dbb7a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:33.678447 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0e6a0875-3d69-4164-9b53-a5776b1dbb7a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:33.682503 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0e6a0875-3d69-4164-9b53-a5776b1dbb7a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:33.683517 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0e6a0875-3d69-4164-9b53-a5776b1dbb7a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:33.686542 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0e6a0875-3d69-4164-9b53-a5776b1dbb7a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:33.687297 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0e6a0875-3d69-4164-9b53-a5776b1dbb7a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:33.689496 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0e6a0875-3d69-4164-9b53-a5776b1dbb7a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:33.728053 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell1:SELECT=100 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:33.778295 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a9dda13c-0d18-4573-a34f-2944da8e0245 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a959dec6c0c944aea231b65612892705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968cc9376f884f67b20b91547211fffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:33.789533 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-a9dda13c-0d18-4573-a34f-2944da8e0245 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 200 len: 1314 microversion: 2.1 time: 0.231762 Sep 03 03:49:33.790342 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 33/74] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:33 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:33.817998 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-98d9a313-1fe5-46f1-ad51-7a54a38aaf19 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:33.820029 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-98d9a313-1fe5-46f1-ad51-7a54a38aaf19 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:33.831527 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-98d9a313-1fe5-46f1-ad51-7a54a38aaf19 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:33.832682 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-98d9a313-1fe5-46f1-ad51-7a54a38aaf19 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:33.833577 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-98d9a313-1fe5-46f1-ad51-7a54a38aaf19 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:33.834392 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-98d9a313-1fe5-46f1-ad51-7a54a38aaf19 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:33.834977 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-98d9a313-1fe5-46f1-ad51-7a54a38aaf19 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:33.835502 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-98d9a313-1fe5-46f1-ad51-7a54a38aaf19 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:33.978022 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-0e6a0875-3d69-4164-9b53-a5776b1dbb7a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:34.002482 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-0e6a0875-3d69-4164-9b53-a5776b1dbb7a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1321 microversion: 2.1 time: 0.323387 Sep 03 03:49:34.002482 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 42/75] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:33 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1321 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:49:34.128575 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-98d9a313-1fe5-46f1-ad51-7a54a38aaf19 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:34.141663 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-98d9a313-1fe5-46f1-ad51-7a54a38aaf19 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1364 microversion: 2.1 time: 0.336687 Sep 03 03:49:34.156460 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 34/76] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:33 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1364 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:34.168320 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-67dbcbc9-53dc-4be3-9639-1b4faaee7e6e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:34.169208 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-67dbcbc9-53dc-4be3-9639-1b4faaee7e6e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:34.172634 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:34.182876 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-67dbcbc9-53dc-4be3-9639-1b4faaee7e6e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:34.198275 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-67dbcbc9-53dc-4be3-9639-1b4faaee7e6e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:34.199485 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-67dbcbc9-53dc-4be3-9639-1b4faaee7e6e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:34.203775 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-67dbcbc9-53dc-4be3-9639-1b4faaee7e6e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:34.206745 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-67dbcbc9-53dc-4be3-9639-1b4faaee7e6e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:34.207897 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-67dbcbc9-53dc-4be3-9639-1b4faaee7e6e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:34.210631 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell0:SELECT=6 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:34.423062 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-5e485062-031f-4bea-8f17-957f29c00d6f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:34.423795 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-5e485062-031f-4bea-8f17-957f29c00d6f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:34.445738 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5e485062-031f-4bea-8f17-957f29c00d6f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:34.447130 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5e485062-031f-4bea-8f17-957f29c00d6f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:34.450238 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5e485062-031f-4bea-8f17-957f29c00d6f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:34.451995 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5e485062-031f-4bea-8f17-957f29c00d6f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:34.453763 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5e485062-031f-4bea-8f17-957f29c00d6f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:34.457776 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5e485062-031f-4bea-8f17-957f29c00d6f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:34.475562 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-67dbcbc9-53dc-4be3-9639-1b4faaee7e6e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:34.485482 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-67dbcbc9-53dc-4be3-9639-1b4faaee7e6e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911" status: 200 len: 1365 microversion: 2.1 time: 0.321988 Sep 03 03:49:34.500431 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 43/77] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:34 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 => generated 1365 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:34.557544 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-5e485062-031f-4bea-8f17-957f29c00d6f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:34.574381 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-5e485062-031f-4bea-8f17-957f29c00d6f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:34.582111 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-5e485062-031f-4bea-8f17-957f29c00d6f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:34.586517 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-5e485062-031f-4bea-8f17-957f29c00d6f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1285 microversion: 2.20 time: 0.167753 Sep 03 03:49:34.595517 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 35/78] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:49:34 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1285 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 03:49:34.813384 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-db6ae975-bb7e-40e6-ac5e-766a50fedb86 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:34.814039 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-db6ae975-bb7e-40e6-ac5e-766a50fedb86 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:34.829413 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-db6ae975-bb7e-40e6-ac5e-766a50fedb86 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:34.829987 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-db6ae975-bb7e-40e6-ac5e-766a50fedb86 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:34.830369 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-db6ae975-bb7e-40e6-ac5e-766a50fedb86 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:34.831684 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-db6ae975-bb7e-40e6-ac5e-766a50fedb86 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:34.832177 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-db6ae975-bb7e-40e6-ac5e-766a50fedb86 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:34.832595 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-db6ae975-bb7e-40e6-ac5e-766a50fedb86 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:35.017121 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-eece635b-fbac-432e-b172-db03b98f29ca tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:35.017920 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-eece635b-fbac-432e-b172-db03b98f29ca tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:35.026411 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eece635b-fbac-432e-b172-db03b98f29ca tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:35.032567 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eece635b-fbac-432e-b172-db03b98f29ca tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:35.033265 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eece635b-fbac-432e-b172-db03b98f29ca tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:35.034153 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eece635b-fbac-432e-b172-db03b98f29ca tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:35.034848 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eece635b-fbac-432e-b172-db03b98f29ca tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:35.035425 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eece635b-fbac-432e-b172-db03b98f29ca tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:35.144035 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-db6ae975-bb7e-40e6-ac5e-766a50fedb86 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a959dec6c0c944aea231b65612892705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968cc9376f884f67b20b91547211fffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:35.154104 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-db6ae975-bb7e-40e6-ac5e-766a50fedb86 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 200 len: 1314 microversion: 2.1 time: 0.343976 Sep 03 03:49:35.170866 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 44/79] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:34 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:35.176645 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-40da9367-20b1-4244-8929-7779784492f9 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:35.177590 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-40da9367-20b1-4244-8929-7779784492f9 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:35.186264 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-40da9367-20b1-4244-8929-7779784492f9 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:35.191953 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-40da9367-20b1-4244-8929-7779784492f9 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:35.192534 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-40da9367-20b1-4244-8929-7779784492f9 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:35.193367 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-40da9367-20b1-4244-8929-7779784492f9 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:35.193826 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-40da9367-20b1-4244-8929-7779784492f9 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:35.194252 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-40da9367-20b1-4244-8929-7779784492f9 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:35.248895 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-eece635b-fbac-432e-b172-db03b98f29ca tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:35.266566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-eece635b-fbac-432e-b172-db03b98f29ca tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1321 microversion: 2.1 time: 0.253232 Sep 03 03:49:35.267191 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 36/80] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:35 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1321 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:49:35.462746 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-40da9367-20b1-4244-8929-7779784492f9 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:35.481408 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-40da9367-20b1-4244-8929-7779784492f9 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1364 microversion: 2.1 time: 0.308904 Sep 03 03:49:35.502190 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 45/81] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:35 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1364 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:35.512624 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-0e6d2a07-c11d-49dd-840f-f9b1af17bfa4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:35.513326 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-0e6d2a07-c11d-49dd-840f-f9b1af17bfa4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:35.519634 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0e6d2a07-c11d-49dd-840f-f9b1af17bfa4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:35.520202 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0e6d2a07-c11d-49dd-840f-f9b1af17bfa4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:35.520700 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0e6d2a07-c11d-49dd-840f-f9b1af17bfa4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:35.521467 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0e6d2a07-c11d-49dd-840f-f9b1af17bfa4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:35.521985 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0e6d2a07-c11d-49dd-840f-f9b1af17bfa4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:35.522483 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0e6d2a07-c11d-49dd-840f-f9b1af17bfa4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:35.615764 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-f2398500-b0ad-4c15-ab27-87af2a8df411 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:35.616591 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-f2398500-b0ad-4c15-ab27-87af2a8df411 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:35.626433 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f2398500-b0ad-4c15-ab27-87af2a8df411 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:35.627330 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f2398500-b0ad-4c15-ab27-87af2a8df411 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:35.627985 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f2398500-b0ad-4c15-ab27-87af2a8df411 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:35.629404 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f2398500-b0ad-4c15-ab27-87af2a8df411 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:35.630488 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f2398500-b0ad-4c15-ab27-87af2a8df411 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:35.631228 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f2398500-b0ad-4c15-ab27-87af2a8df411 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:35.715480 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-f2398500-b0ad-4c15-ab27-87af2a8df411 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:35.724009 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-f2398500-b0ad-4c15-ab27-87af2a8df411 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:35.726050 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-f2398500-b0ad-4c15-ab27-87af2a8df411 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:35.727399 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-f2398500-b0ad-4c15-ab27-87af2a8df411 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1285 microversion: 2.20 time: 0.117076 Sep 03 03:49:35.728151 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 46/82] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:49:35 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:49:35.745077 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-0e6d2a07-c11d-49dd-840f-f9b1af17bfa4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:35.753152 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-0e6d2a07-c11d-49dd-840f-f9b1af17bfa4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911" status: 200 len: 1365 microversion: 2.1 time: 0.244601 Sep 03 03:49:35.753816 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 37/83] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:35 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:36.177881 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-5fccc93b-469d-433c-9e67-71bf090bc0f3 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:36.178388 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-5fccc93b-469d-433c-9e67-71bf090bc0f3 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:36.184335 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5fccc93b-469d-433c-9e67-71bf090bc0f3 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:36.184810 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5fccc93b-469d-433c-9e67-71bf090bc0f3 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:36.185260 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5fccc93b-469d-433c-9e67-71bf090bc0f3 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:36.186004 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5fccc93b-469d-433c-9e67-71bf090bc0f3 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:36.186444 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5fccc93b-469d-433c-9e67-71bf090bc0f3 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:36.187077 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5fccc93b-469d-433c-9e67-71bf090bc0f3 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:36.289529 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-7493e9d9-2740-4da7-87d6-34be566047f8 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:36.290138 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-7493e9d9-2740-4da7-87d6-34be566047f8 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:36.297197 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7493e9d9-2740-4da7-87d6-34be566047f8 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:36.297685 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7493e9d9-2740-4da7-87d6-34be566047f8 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:36.298139 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7493e9d9-2740-4da7-87d6-34be566047f8 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:36.298871 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7493e9d9-2740-4da7-87d6-34be566047f8 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:36.299459 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7493e9d9-2740-4da7-87d6-34be566047f8 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:36.299875 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7493e9d9-2740-4da7-87d6-34be566047f8 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:36.378026 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-5fccc93b-469d-433c-9e67-71bf090bc0f3 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a959dec6c0c944aea231b65612892705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968cc9376f884f67b20b91547211fffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:36.387054 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-5fccc93b-469d-433c-9e67-71bf090bc0f3 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 200 len: 1314 microversion: 2.1 time: 0.213027 Sep 03 03:49:36.387655 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 47/84] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:36 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:49:36.469204 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-7493e9d9-2740-4da7-87d6-34be566047f8 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:36.483551 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-7493e9d9-2740-4da7-87d6-34be566047f8 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1321 microversion: 2.1 time: 0.197616 Sep 03 03:49:36.496840 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 38/85] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:36 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:36.510032 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-04f1f23f-8654-430c-a9df-883cccb7534c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:36.510678 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-04f1f23f-8654-430c-a9df-883cccb7534c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:36.516525 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-04f1f23f-8654-430c-a9df-883cccb7534c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:36.517144 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-04f1f23f-8654-430c-a9df-883cccb7534c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:36.517575 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-04f1f23f-8654-430c-a9df-883cccb7534c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:36.518256 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-04f1f23f-8654-430c-a9df-883cccb7534c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:36.518701 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-04f1f23f-8654-430c-a9df-883cccb7534c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:36.519212 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-04f1f23f-8654-430c-a9df-883cccb7534c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:36.670659 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-04f1f23f-8654-430c-a9df-883cccb7534c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:36.680389 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-04f1f23f-8654-430c-a9df-883cccb7534c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1364 microversion: 2.1 time: 0.174441 Sep 03 03:49:36.683204 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 48/86] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:36 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:36.753526 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-3b3435ad-cd5a-4c99-b529-671333b60d0d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:36.754127 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-3b3435ad-cd5a-4c99-b529-671333b60d0d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:36.760101 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3b3435ad-cd5a-4c99-b529-671333b60d0d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:36.760575 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3b3435ad-cd5a-4c99-b529-671333b60d0d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:36.760996 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3b3435ad-cd5a-4c99-b529-671333b60d0d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:36.761681 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3b3435ad-cd5a-4c99-b529-671333b60d0d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:36.762121 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3b3435ad-cd5a-4c99-b529-671333b60d0d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:36.762531 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3b3435ad-cd5a-4c99-b529-671333b60d0d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:36.775986 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-19c46efb-b1f1-4e54-a7b8-1e1ee3ae4603 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:36.777136 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-19c46efb-b1f1-4e54-a7b8-1e1ee3ae4603 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:36.784252 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-19c46efb-b1f1-4e54-a7b8-1e1ee3ae4603 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:36.785373 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-19c46efb-b1f1-4e54-a7b8-1e1ee3ae4603 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:36.785373 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-19c46efb-b1f1-4e54-a7b8-1e1ee3ae4603 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:36.785949 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-19c46efb-b1f1-4e54-a7b8-1e1ee3ae4603 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:36.786390 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-19c46efb-b1f1-4e54-a7b8-1e1ee3ae4603 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:36.786827 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-19c46efb-b1f1-4e54-a7b8-1e1ee3ae4603 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:36.842042 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-3b3435ad-cd5a-4c99-b529-671333b60d0d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:36.851856 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-3b3435ad-cd5a-4c99-b529-671333b60d0d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:36.853125 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-3b3435ad-cd5a-4c99-b529-671333b60d0d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:36.860232 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-3b3435ad-cd5a-4c99-b529-671333b60d0d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1285 microversion: 2.20 time: 0.110476 Sep 03 03:49:36.861388 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 39/87] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:49:36 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:49:36.995763 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-19c46efb-b1f1-4e54-a7b8-1e1ee3ae4603 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:37.010913 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-19c46efb-b1f1-4e54-a7b8-1e1ee3ae4603 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911" status: 200 len: 1365 microversion: 2.1 time: 0.238679 Sep 03 03:49:37.011569 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 49/88] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:36 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 => generated 1365 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:49:37.418550 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-32adfedc-1750-46ae-ae02-c985335be907 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:37.419174 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-32adfedc-1750-46ae-ae02-c985335be907 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:37.425197 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-32adfedc-1750-46ae-ae02-c985335be907 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:37.425671 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-32adfedc-1750-46ae-ae02-c985335be907 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:37.426093 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-32adfedc-1750-46ae-ae02-c985335be907 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:37.426953 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-32adfedc-1750-46ae-ae02-c985335be907 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:37.427394 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-32adfedc-1750-46ae-ae02-c985335be907 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:37.427805 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-32adfedc-1750-46ae-ae02-c985335be907 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:37.446672 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell1:SELECT=100 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:37.510673 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-eb7b3699-4dd7-4eaf-a3f8-634b48f24085 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:37.511336 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-eb7b3699-4dd7-4eaf-a3f8-634b48f24085 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:37.521767 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-eb7b3699-4dd7-4eaf-a3f8-634b48f24085 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:37.521767 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-eb7b3699-4dd7-4eaf-a3f8-634b48f24085 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:37.522111 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-eb7b3699-4dd7-4eaf-a3f8-634b48f24085 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:37.522857 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-eb7b3699-4dd7-4eaf-a3f8-634b48f24085 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:37.523970 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-eb7b3699-4dd7-4eaf-a3f8-634b48f24085 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:37.523970 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-eb7b3699-4dd7-4eaf-a3f8-634b48f24085 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:37.596305 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-32adfedc-1750-46ae-ae02-c985335be907 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a959dec6c0c944aea231b65612892705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968cc9376f884f67b20b91547211fffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:37.604940 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-32adfedc-1750-46ae-ae02-c985335be907 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 200 len: 1314 microversion: 2.1 time: 0.190148 Sep 03 03:49:37.605516 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 40/89] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:37 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:37.671773 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-eb7b3699-4dd7-4eaf-a3f8-634b48f24085 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:37.679489 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-eb7b3699-4dd7-4eaf-a3f8-634b48f24085 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1321 microversion: 2.1 time: 0.174798 Sep 03 03:49:37.680048 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 50/90] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:37 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:37.705282 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-0bbac8ec-2e16-4e17-afac-ec96891e1a21 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:37.706150 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-0bbac8ec-2e16-4e17-afac-ec96891e1a21 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:37.717757 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0bbac8ec-2e16-4e17-afac-ec96891e1a21 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:37.718466 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0bbac8ec-2e16-4e17-afac-ec96891e1a21 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:37.719076 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0bbac8ec-2e16-4e17-afac-ec96891e1a21 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:37.719766 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0bbac8ec-2e16-4e17-afac-ec96891e1a21 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:37.720260 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0bbac8ec-2e16-4e17-afac-ec96891e1a21 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:37.720836 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0bbac8ec-2e16-4e17-afac-ec96891e1a21 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:37.885059 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-0bbac8ec-2e16-4e17-afac-ec96891e1a21 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:37.898983 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-c5200e3e-7156-4500-939e-085d8637412e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:37.898983 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-c5200e3e-7156-4500-939e-085d8637412e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:37.899329 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-0bbac8ec-2e16-4e17-afac-ec96891e1a21 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1364 microversion: 2.1 time: 0.193340 Sep 03 03:49:37.899329 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 41/91] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:37 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1364 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:37.915617 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c5200e3e-7156-4500-939e-085d8637412e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:37.916275 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c5200e3e-7156-4500-939e-085d8637412e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:37.916794 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c5200e3e-7156-4500-939e-085d8637412e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:37.917574 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c5200e3e-7156-4500-939e-085d8637412e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:37.918186 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c5200e3e-7156-4500-939e-085d8637412e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:37.919373 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c5200e3e-7156-4500-939e-085d8637412e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:38.007301 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-c5200e3e-7156-4500-939e-085d8637412e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:38.015683 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-c5200e3e-7156-4500-939e-085d8637412e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:38.017116 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-c5200e3e-7156-4500-939e-085d8637412e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:38.018212 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-c5200e3e-7156-4500-939e-085d8637412e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1285 microversion: 2.20 time: 0.130080 Sep 03 03:49:38.018845 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 51/92] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:49:37 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1285 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:49:38.043299 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-a05f0d52-f1ca-44d4-a333-3e8907a7ca20 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:38.043980 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-a05f0d52-f1ca-44d4-a333-3e8907a7ca20 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:38.063751 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a05f0d52-f1ca-44d4-a333-3e8907a7ca20 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:38.063751 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a05f0d52-f1ca-44d4-a333-3e8907a7ca20 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:38.063751 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a05f0d52-f1ca-44d4-a333-3e8907a7ca20 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:38.064548 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a05f0d52-f1ca-44d4-a333-3e8907a7ca20 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:38.066485 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a05f0d52-f1ca-44d4-a333-3e8907a7ca20 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:38.067087 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a05f0d52-f1ca-44d4-a333-3e8907a7ca20 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:38.293601 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a05f0d52-f1ca-44d4-a333-3e8907a7ca20 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:38.301772 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-a05f0d52-f1ca-44d4-a333-3e8907a7ca20 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911" status: 200 len: 1365 microversion: 2.1 time: 0.263361 Sep 03 03:49:38.311320 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 42/93] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:38 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 => generated 1365 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:38.628828 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-2d72f8f1-9a79-4bca-a35a-6340d78b5a00 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:38.629427 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-2d72f8f1-9a79-4bca-a35a-6340d78b5a00 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:38.635719 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2d72f8f1-9a79-4bca-a35a-6340d78b5a00 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:38.636198 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2d72f8f1-9a79-4bca-a35a-6340d78b5a00 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:38.636628 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2d72f8f1-9a79-4bca-a35a-6340d78b5a00 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:38.637318 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2d72f8f1-9a79-4bca-a35a-6340d78b5a00 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:38.637761 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2d72f8f1-9a79-4bca-a35a-6340d78b5a00 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:38.638178 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2d72f8f1-9a79-4bca-a35a-6340d78b5a00 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:38.701673 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-548e63bd-f9ec-47c8-87b8-b77a10fe9b0d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:38.702527 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-548e63bd-f9ec-47c8-87b8-b77a10fe9b0d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:38.708813 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-548e63bd-f9ec-47c8-87b8-b77a10fe9b0d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:38.709553 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-548e63bd-f9ec-47c8-87b8-b77a10fe9b0d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:38.710164 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-548e63bd-f9ec-47c8-87b8-b77a10fe9b0d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:38.710904 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-548e63bd-f9ec-47c8-87b8-b77a10fe9b0d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:38.711346 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-548e63bd-f9ec-47c8-87b8-b77a10fe9b0d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:38.711761 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-548e63bd-f9ec-47c8-87b8-b77a10fe9b0d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:38.797196 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-2d72f8f1-9a79-4bca-a35a-6340d78b5a00 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a959dec6c0c944aea231b65612892705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968cc9376f884f67b20b91547211fffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:38.805948 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-2d72f8f1-9a79-4bca-a35a-6340d78b5a00 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 200 len: 1314 microversion: 2.1 time: 0.180955 Sep 03 03:49:38.807149 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 52/94] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:38 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:38.895087 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-548e63bd-f9ec-47c8-87b8-b77a10fe9b0d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:38.905833 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-548e63bd-f9ec-47c8-87b8-b77a10fe9b0d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1321 microversion: 2.1 time: 0.206733 Sep 03 03:49:38.916829 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 43/95] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:38 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:49:38.922346 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-faeedb1a-e2b4-4338-8745-f92b1b8168be tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:38.922832 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-faeedb1a-e2b4-4338-8745-f92b1b8168be tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:38.939734 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-faeedb1a-e2b4-4338-8745-f92b1b8168be tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:38.940329 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-faeedb1a-e2b4-4338-8745-f92b1b8168be tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:38.940944 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-faeedb1a-e2b4-4338-8745-f92b1b8168be tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:38.941984 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-faeedb1a-e2b4-4338-8745-f92b1b8168be tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:38.942508 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-faeedb1a-e2b4-4338-8745-f92b1b8168be tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:38.943045 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-faeedb1a-e2b4-4338-8745-f92b1b8168be tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:39.043300 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-c5222b70-b248-4c68-9e98-732f656426cc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:39.044085 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-c5222b70-b248-4c68-9e98-732f656426cc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:39.053334 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c5222b70-b248-4c68-9e98-732f656426cc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:39.058229 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c5222b70-b248-4c68-9e98-732f656426cc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:39.059084 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c5222b70-b248-4c68-9e98-732f656426cc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:39.064989 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c5222b70-b248-4c68-9e98-732f656426cc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:39.065839 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c5222b70-b248-4c68-9e98-732f656426cc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:39.066462 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c5222b70-b248-4c68-9e98-732f656426cc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:39.098212 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-faeedb1a-e2b4-4338-8745-f92b1b8168be tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:39.106171 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-faeedb1a-e2b4-4338-8745-f92b1b8168be tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1364 microversion: 2.1 time: 0.188264 Sep 03 03:49:39.106743 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 53/96] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:38 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:49:39.133313 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-c5222b70-b248-4c68-9e98-732f656426cc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:39.141493 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-c5222b70-b248-4c68-9e98-732f656426cc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:39.142923 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-c5222b70-b248-4c68-9e98-732f656426cc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:39.145902 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-c5222b70-b248-4c68-9e98-732f656426cc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1285 microversion: 2.20 time: 0.104630 Sep 03 03:49:39.146470 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 44/97] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:49:39 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 03:49:39.325286 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-958108bf-5fb6-43dd-abee-a0d0cb0822c3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:39.325876 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-958108bf-5fb6-43dd-abee-a0d0cb0822c3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:39.332158 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-958108bf-5fb6-43dd-abee-a0d0cb0822c3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:39.332625 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-958108bf-5fb6-43dd-abee-a0d0cb0822c3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:39.333044 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-958108bf-5fb6-43dd-abee-a0d0cb0822c3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:39.333710 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-958108bf-5fb6-43dd-abee-a0d0cb0822c3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:39.334146 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-958108bf-5fb6-43dd-abee-a0d0cb0822c3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:39.334536 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-958108bf-5fb6-43dd-abee-a0d0cb0822c3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:39.474409 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-958108bf-5fb6-43dd-abee-a0d0cb0822c3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:39.485177 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-958108bf-5fb6-43dd-abee-a0d0cb0822c3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911" status: 200 len: 1365 microversion: 2.1 time: 0.163622 Sep 03 03:49:39.485834 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 54/98] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:39 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:39.829590 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-ad83b299-0c14-4a8c-b5e0-8c0d7fdd4c00 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:39.830212 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-ad83b299-0c14-4a8c-b5e0-8c0d7fdd4c00 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:39.836370 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ad83b299-0c14-4a8c-b5e0-8c0d7fdd4c00 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:39.836840 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ad83b299-0c14-4a8c-b5e0-8c0d7fdd4c00 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:39.837265 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ad83b299-0c14-4a8c-b5e0-8c0d7fdd4c00 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:39.837924 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ad83b299-0c14-4a8c-b5e0-8c0d7fdd4c00 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:39.838362 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ad83b299-0c14-4a8c-b5e0-8c0d7fdd4c00 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:39.838767 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ad83b299-0c14-4a8c-b5e0-8c0d7fdd4c00 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:39.936076 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-2fa2c8e2-cd9a-410a-9a9a-6884b6b5c49c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:39.936662 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-2fa2c8e2-cd9a-410a-9a9a-6884b6b5c49c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:39.943966 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2fa2c8e2-cd9a-410a-9a9a-6884b6b5c49c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:39.944453 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2fa2c8e2-cd9a-410a-9a9a-6884b6b5c49c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:39.944875 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2fa2c8e2-cd9a-410a-9a9a-6884b6b5c49c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:39.945544 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2fa2c8e2-cd9a-410a-9a9a-6884b6b5c49c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:39.946015 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2fa2c8e2-cd9a-410a-9a9a-6884b6b5c49c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:39.946426 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2fa2c8e2-cd9a-410a-9a9a-6884b6b5c49c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:39.979814 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-ad83b299-0c14-4a8c-b5e0-8c0d7fdd4c00 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a959dec6c0c944aea231b65612892705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968cc9376f884f67b20b91547211fffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:39.991059 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-ad83b299-0c14-4a8c-b5e0-8c0d7fdd4c00 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 200 len: 1314 microversion: 2.1 time: 0.165284 Sep 03 03:49:40.003624 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 45/99] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:39 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:40.083141 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-2fa2c8e2-cd9a-410a-9a9a-6884b6b5c49c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:40.091521 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-2fa2c8e2-cd9a-410a-9a9a-6884b6b5c49c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1321 microversion: 2.1 time: 0.159700 Sep 03 03:49:40.092079 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 55/100] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:39 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:40.133416 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-496fd602-c4ee-4d38-b191-3f1fb43b6be9 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:40.134014 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-496fd602-c4ee-4d38-b191-3f1fb43b6be9 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:40.140358 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-496fd602-c4ee-4d38-b191-3f1fb43b6be9 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:40.140855 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-496fd602-c4ee-4d38-b191-3f1fb43b6be9 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:40.141280 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-496fd602-c4ee-4d38-b191-3f1fb43b6be9 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:40.141966 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-496fd602-c4ee-4d38-b191-3f1fb43b6be9 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:40.142409 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-496fd602-c4ee-4d38-b191-3f1fb43b6be9 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:40.142837 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-496fd602-c4ee-4d38-b191-3f1fb43b6be9 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:40.171247 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-95823583-198a-4c91-8eb1-3ca8acd1da51 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:40.171754 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-95823583-198a-4c91-8eb1-3ca8acd1da51 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:40.178066 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-95823583-198a-4c91-8eb1-3ca8acd1da51 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:40.178530 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-95823583-198a-4c91-8eb1-3ca8acd1da51 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:40.178991 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-95823583-198a-4c91-8eb1-3ca8acd1da51 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:40.179669 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-95823583-198a-4c91-8eb1-3ca8acd1da51 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:40.180109 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-95823583-198a-4c91-8eb1-3ca8acd1da51 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:40.180520 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-95823583-198a-4c91-8eb1-3ca8acd1da51 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:40.241540 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-95823583-198a-4c91-8eb1-3ca8acd1da51 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:40.251087 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-95823583-198a-4c91-8eb1-3ca8acd1da51 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:40.252547 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-95823583-198a-4c91-8eb1-3ca8acd1da51 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:40.253925 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-95823583-198a-4c91-8eb1-3ca8acd1da51 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1285 microversion: 2.20 time: 0.086765 Sep 03 03:49:40.254463 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 56/101] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:49:40 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 03:49:40.279585 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-496fd602-c4ee-4d38-b191-3f1fb43b6be9 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:40.289095 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-496fd602-c4ee-4d38-b191-3f1fb43b6be9 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1364 microversion: 2.1 time: 0.159532 Sep 03 03:49:40.289666 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 46/102] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:40 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:40.507996 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-4d2c3d09-25c1-42e3-ad30-e0bacae5e6df tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:40.508624 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-4d2c3d09-25c1-42e3-ad30-e0bacae5e6df tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:40.515040 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4d2c3d09-25c1-42e3-ad30-e0bacae5e6df tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:40.515520 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4d2c3d09-25c1-42e3-ad30-e0bacae5e6df tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:40.515946 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4d2c3d09-25c1-42e3-ad30-e0bacae5e6df tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:40.516627 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4d2c3d09-25c1-42e3-ad30-e0bacae5e6df tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:40.517048 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4d2c3d09-25c1-42e3-ad30-e0bacae5e6df tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:40.517490 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4d2c3d09-25c1-42e3-ad30-e0bacae5e6df tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:40.650192 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-4d2c3d09-25c1-42e3-ad30-e0bacae5e6df tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:40.661886 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-4d2c3d09-25c1-42e3-ad30-e0bacae5e6df tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911" status: 200 len: 1365 microversion: 2.1 time: 0.157337 Sep 03 03:49:40.662663 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 57/103] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:40 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:41.018517 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-f7a402ac-7103-44b8-9a6b-c0739de5a017 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:41.019593 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-f7a402ac-7103-44b8-9a6b-c0739de5a017 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:41.029423 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f7a402ac-7103-44b8-9a6b-c0739de5a017 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:41.030262 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f7a402ac-7103-44b8-9a6b-c0739de5a017 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:41.031032 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f7a402ac-7103-44b8-9a6b-c0739de5a017 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:41.032150 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f7a402ac-7103-44b8-9a6b-c0739de5a017 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:41.032885 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f7a402ac-7103-44b8-9a6b-c0739de5a017 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:41.033573 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f7a402ac-7103-44b8-9a6b-c0739de5a017 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:41.116658 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-5c538d5d-cfc7-42a3-b34a-7c119d0da20e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:41.117329 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-5c538d5d-cfc7-42a3-b34a-7c119d0da20e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:41.124684 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5c538d5d-cfc7-42a3-b34a-7c119d0da20e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:41.125162 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5c538d5d-cfc7-42a3-b34a-7c119d0da20e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:41.125585 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5c538d5d-cfc7-42a3-b34a-7c119d0da20e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:41.126264 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5c538d5d-cfc7-42a3-b34a-7c119d0da20e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:41.126705 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5c538d5d-cfc7-42a3-b34a-7c119d0da20e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:41.127152 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5c538d5d-cfc7-42a3-b34a-7c119d0da20e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:41.166244 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-f7a402ac-7103-44b8-9a6b-c0739de5a017 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a959dec6c0c944aea231b65612892705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968cc9376f884f67b20b91547211fffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:41.174264 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-f7a402ac-7103-44b8-9a6b-c0739de5a017 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 200 len: 1314 microversion: 2.1 time: 0.161939 Sep 03 03:49:41.174933 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 47/104] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:41 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:41.261786 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-5c538d5d-cfc7-42a3-b34a-7c119d0da20e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:41.270343 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-5c538d5d-cfc7-42a3-b34a-7c119d0da20e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1321 microversion: 2.1 time: 0.158099 Sep 03 03:49:41.270975 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 58/105] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:41 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:41.277845 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-7d24b873-a102-428a-8d55-7a323bb6eb46 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:41.278455 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-7d24b873-a102-428a-8d55-7a323bb6eb46 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:41.285139 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7d24b873-a102-428a-8d55-7a323bb6eb46 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:41.285606 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7d24b873-a102-428a-8d55-7a323bb6eb46 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:41.286040 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7d24b873-a102-428a-8d55-7a323bb6eb46 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:41.286741 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7d24b873-a102-428a-8d55-7a323bb6eb46 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:41.287219 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7d24b873-a102-428a-8d55-7a323bb6eb46 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:41.287663 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7d24b873-a102-428a-8d55-7a323bb6eb46 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:41.312671 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-5751b2a8-e755-4e99-9d5a-c6eadb08bf9f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:41.313534 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-5751b2a8-e755-4e99-9d5a-c6eadb08bf9f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:41.320292 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5751b2a8-e755-4e99-9d5a-c6eadb08bf9f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:41.320930 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5751b2a8-e755-4e99-9d5a-c6eadb08bf9f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:41.321472 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5751b2a8-e755-4e99-9d5a-c6eadb08bf9f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:41.322272 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5751b2a8-e755-4e99-9d5a-c6eadb08bf9f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:41.322849 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5751b2a8-e755-4e99-9d5a-c6eadb08bf9f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:41.323380 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5751b2a8-e755-4e99-9d5a-c6eadb08bf9f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:41.328192 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell1:SELECT=100 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:41.353350 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-7d24b873-a102-428a-8d55-7a323bb6eb46 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:41.362289 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-7d24b873-a102-428a-8d55-7a323bb6eb46 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:41.363906 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-7d24b873-a102-428a-8d55-7a323bb6eb46 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:41.364969 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-7d24b873-a102-428a-8d55-7a323bb6eb46 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1285 microversion: 2.20 time: 0.091104 Sep 03 03:49:41.365518 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 48/106] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:49:41 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 03:49:41.459524 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-5751b2a8-e755-4e99-9d5a-c6eadb08bf9f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:41.468498 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-5751b2a8-e755-4e99-9d5a-c6eadb08bf9f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1364 microversion: 2.1 time: 0.159505 Sep 03 03:49:41.469300 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 59/107] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:41 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:49:41.693579 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-d82b2bb5-f909-4102-878b-e13061462f38 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:41.694559 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-d82b2bb5-f909-4102-878b-e13061462f38 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:41.704866 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d82b2bb5-f909-4102-878b-e13061462f38 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:41.705649 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d82b2bb5-f909-4102-878b-e13061462f38 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:41.706339 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d82b2bb5-f909-4102-878b-e13061462f38 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:41.707241 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d82b2bb5-f909-4102-878b-e13061462f38 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:41.707681 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d82b2bb5-f909-4102-878b-e13061462f38 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:41.708088 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d82b2bb5-f909-4102-878b-e13061462f38 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:41.850429 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-d82b2bb5-f909-4102-878b-e13061462f38 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:41.858878 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-d82b2bb5-f909-4102-878b-e13061462f38 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911" status: 200 len: 1365 microversion: 2.1 time: 0.171929 Sep 03 03:49:41.859445 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 49/108] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:41 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:42.199360 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-32e566dd-79bf-47d5-b6e2-3d3a52b28081 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:42.200927 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-32e566dd-79bf-47d5-b6e2-3d3a52b28081 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:42.207713 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-32e566dd-79bf-47d5-b6e2-3d3a52b28081 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:42.208378 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-32e566dd-79bf-47d5-b6e2-3d3a52b28081 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:42.208959 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-32e566dd-79bf-47d5-b6e2-3d3a52b28081 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:42.209826 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-32e566dd-79bf-47d5-b6e2-3d3a52b28081 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:42.210421 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-32e566dd-79bf-47d5-b6e2-3d3a52b28081 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:42.211014 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-32e566dd-79bf-47d5-b6e2-3d3a52b28081 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:42.271843 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell0:SELECT=24 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:42.295666 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-647d7147-e04b-4963-9c10-b236e5ccbdb9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:42.296652 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-647d7147-e04b-4963-9c10-b236e5ccbdb9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:42.301634 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell0:SELECT=6 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:42.303107 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell0:SELECT=34 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:42.317540 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-647d7147-e04b-4963-9c10-b236e5ccbdb9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:42.320398 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-647d7147-e04b-4963-9c10-b236e5ccbdb9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:42.321254 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-647d7147-e04b-4963-9c10-b236e5ccbdb9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:42.322833 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-647d7147-e04b-4963-9c10-b236e5ccbdb9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:42.326033 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-647d7147-e04b-4963-9c10-b236e5ccbdb9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:42.327554 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-647d7147-e04b-4963-9c10-b236e5ccbdb9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:42.700635 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-32e566dd-79bf-47d5-b6e2-3d3a52b28081 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a959dec6c0c944aea231b65612892705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968cc9376f884f67b20b91547211fffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:42.724151 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-32e566dd-79bf-47d5-b6e2-3d3a52b28081 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 200 len: 1314 microversion: 2.1 time: 0.525648 Sep 03 03:49:42.727064 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 60/109] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:42 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 1314 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:42.741712 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-6718c55d-9f9d-44db-aef8-da3c0824da2a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:42.745469 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-6718c55d-9f9d-44db-aef8-da3c0824da2a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:42.762234 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6718c55d-9f9d-44db-aef8-da3c0824da2a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:42.763319 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6718c55d-9f9d-44db-aef8-da3c0824da2a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:42.763999 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6718c55d-9f9d-44db-aef8-da3c0824da2a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:42.765030 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6718c55d-9f9d-44db-aef8-da3c0824da2a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:42.766926 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6718c55d-9f9d-44db-aef8-da3c0824da2a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:42.767586 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6718c55d-9f9d-44db-aef8-da3c0824da2a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:42.969814 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-647d7147-e04b-4963-9c10-b236e5ccbdb9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:42.984105 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-647d7147-e04b-4963-9c10-b236e5ccbdb9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1321 microversion: 2.1 time: 0.692425 Sep 03 03:49:42.985350 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 50/110] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:42 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1321 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:49:42.995298 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-a286c146-afca-4ee2-99c7-834498af4481 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:42.998761 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-a286c146-afca-4ee2-99c7-834498af4481 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:43.009634 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a286c146-afca-4ee2-99c7-834498af4481 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:43.012514 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a286c146-afca-4ee2-99c7-834498af4481 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:43.013193 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a286c146-afca-4ee2-99c7-834498af4481 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:43.016870 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a286c146-afca-4ee2-99c7-834498af4481 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:43.017621 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a286c146-afca-4ee2-99c7-834498af4481 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:43.018250 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a286c146-afca-4ee2-99c7-834498af4481 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:43.129458 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-6718c55d-9f9d-44db-aef8-da3c0824da2a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:43.141564 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-6718c55d-9f9d-44db-aef8-da3c0824da2a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:43.143193 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-6718c55d-9f9d-44db-aef8-da3c0824da2a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:43.145697 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-6718c55d-9f9d-44db-aef8-da3c0824da2a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1333 microversion: 2.20 time: 0.416972 Sep 03 03:49:43.148616 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 61/111] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:49:42 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1333 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:49:43.158437 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-8ac39150-dbc0-4cbb-b493-4d06a501aaca tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:43.163947 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-8ac39150-dbc0-4cbb-b493-4d06a501aaca tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:43.185439 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8ac39150-dbc0-4cbb-b493-4d06a501aaca tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:43.186536 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8ac39150-dbc0-4cbb-b493-4d06a501aaca tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:43.187372 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8ac39150-dbc0-4cbb-b493-4d06a501aaca tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:43.188700 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8ac39150-dbc0-4cbb-b493-4d06a501aaca tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:43.189337 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8ac39150-dbc0-4cbb-b493-4d06a501aaca tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:43.190202 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8ac39150-dbc0-4cbb-b493-4d06a501aaca tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:43.655996 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-8ac39150-dbc0-4cbb-b493-4d06a501aaca tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:43.667889 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-8ac39150-dbc0-4cbb-b493-4d06a501aaca tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911" status: 200 len: 1365 microversion: 2.1 time: 0.516249 Sep 03 03:49:43.695077 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 62/112] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:43 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 => generated 1365 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:43.760550 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-396156da-9c6c-4b73-b966-cff1b63bf1fb tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:43.761854 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-396156da-9c6c-4b73-b966-cff1b63bf1fb tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:43.770510 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-396156da-9c6c-4b73-b966-cff1b63bf1fb tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:43.771451 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-396156da-9c6c-4b73-b966-cff1b63bf1fb tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:43.772043 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-396156da-9c6c-4b73-b966-cff1b63bf1fb tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:43.772782 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-396156da-9c6c-4b73-b966-cff1b63bf1fb tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:43.773239 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-396156da-9c6c-4b73-b966-cff1b63bf1fb tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:43.773437 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a286c146-afca-4ee2-99c7-834498af4481 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:43.773929 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-396156da-9c6c-4b73-b966-cff1b63bf1fb tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:43.781777 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-a286c146-afca-4ee2-99c7-834498af4481 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1364 microversion: 2.1 time: 0.795203 Sep 03 03:49:43.782717 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 51/113] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:42 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1364 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:44.010609 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-76174d56-3ea2-4fc3-bf93-5777d2d3a071 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:44.011244 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-76174d56-3ea2-4fc3-bf93-5777d2d3a071 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:44.020835 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-76174d56-3ea2-4fc3-bf93-5777d2d3a071 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:44.021807 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-76174d56-3ea2-4fc3-bf93-5777d2d3a071 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:44.022422 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-76174d56-3ea2-4fc3-bf93-5777d2d3a071 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:44.028372 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-76174d56-3ea2-4fc3-bf93-5777d2d3a071 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:44.028845 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-76174d56-3ea2-4fc3-bf93-5777d2d3a071 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:44.029271 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-76174d56-3ea2-4fc3-bf93-5777d2d3a071 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:44.346149 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-396156da-9c6c-4b73-b966-cff1b63bf1fb tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a959dec6c0c944aea231b65612892705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968cc9376f884f67b20b91547211fffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:44.358003 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-396156da-9c6c-4b73-b966-cff1b63bf1fb tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 200 len: 1314 microversion: 2.1 time: 0.607857 Sep 03 03:49:44.373814 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 63/114] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:43 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 1314 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:44.384509 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-07808e9d-3d40-4b24-b68a-ea3ffb241c15 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:44.385316 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-07808e9d-3d40-4b24-b68a-ea3ffb241c15 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:44.393056 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-07808e9d-3d40-4b24-b68a-ea3ffb241c15 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:44.394148 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-07808e9d-3d40-4b24-b68a-ea3ffb241c15 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:44.394910 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-07808e9d-3d40-4b24-b68a-ea3ffb241c15 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:44.395889 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-07808e9d-3d40-4b24-b68a-ea3ffb241c15 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:44.396484 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-07808e9d-3d40-4b24-b68a-ea3ffb241c15 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:44.397099 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-07808e9d-3d40-4b24-b68a-ea3ffb241c15 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:44.513234 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-07808e9d-3d40-4b24-b68a-ea3ffb241c15 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:44.526006 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-07808e9d-3d40-4b24-b68a-ea3ffb241c15 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:44.529063 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-07808e9d-3d40-4b24-b68a-ea3ffb241c15 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:44.535506 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-07808e9d-3d40-4b24-b68a-ea3ffb241c15 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1339 microversion: 2.20 time: 0.156539 Sep 03 03:49:44.536324 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 64/115] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:49:44 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1339 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:49:44.656083 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-4a0f22f9-f28e-48d3-b81b-9f6a1a3aacb1 req-9f503089-3272-40cc-a9a5-a6c415808138 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69fe618d-1192-4541-9d90-e5cee06be911", "tag": "1197b605-d728-4d04-90d2-9befd8120dd4"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:49:44.676992 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-4a0f22f9-f28e-48d3-b81b-9f6a1a3aacb1 req-9f503089-3272-40cc-a9a5-a6c415808138 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:44.677642 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-4a0f22f9-f28e-48d3-b81b-9f6a1a3aacb1 req-9f503089-3272-40cc-a9a5-a6c415808138 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:44.678302 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-4a0f22f9-f28e-48d3-b81b-9f6a1a3aacb1 req-9f503089-3272-40cc-a9a5-a6c415808138 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:44.703312 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-76174d56-3ea2-4fc3-bf93-5777d2d3a071 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:44.704995 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-4a0f22f9-f28e-48d3-b81b-9f6a1a3aacb1 req-9f503089-3272-40cc-a9a5-a6c415808138 service nova] Creating event network-changed:1197b605-d728-4d04-90d2-9befd8120dd4 for instance 69fe618d-1192-4541-9d90-e5cee06be911 on hv-cinder-79966 Sep 03 03:49:44.706306 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-4a0f22f9-f28e-48d3-b81b-9f6a1a3aacb1 req-9f503089-3272-40cc-a9a5-a6c415808138 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132076) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 03 03:49:44.706918 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-4a0f22f9-f28e-48d3-b81b-9f6a1a3aacb1 req-9f503089-3272-40cc-a9a5-a6c415808138 service nova] Acquired lock "compute-rpcapi-router" {{(pid=132076) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 03 03:49:44.708504 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e647ecc5-fc48-4e09-bc2a-768bb74e6ada None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:44.709327 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e647ecc5-fc48-4e09-bc2a-768bb74e6ada None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:44.710415 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e647ecc5-fc48-4e09-bc2a-768bb74e6ada None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:44.711289 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e647ecc5-fc48-4e09-bc2a-768bb74e6ada None None] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:44.711974 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e647ecc5-fc48-4e09-bc2a-768bb74e6ada None None] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:44.712488 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e647ecc5-fc48-4e09-bc2a-768bb74e6ada None None] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:44.713392 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-76174d56-3ea2-4fc3-bf93-5777d2d3a071 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1321 microversion: 2.1 time: 0.706806 Sep 03 03:49:44.714753 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 52/116] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:44 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1321 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:49:44.720134 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-25aa7193-02de-4400-b85a-300415b08c4c tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:44.721031 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-25aa7193-02de-4400-b85a-300415b08c4c tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:44.727861 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.compute.rpcapi [None req-e647ecc5-fc48-4e09-bc2a-768bb74e6ada None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 03 03:49:44.729066 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-25aa7193-02de-4400-b85a-300415b08c4c tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:44.729408 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e647ecc5-fc48-4e09-bc2a-768bb74e6ada None None] Releasing lock "compute-rpcapi-router" {{(pid=132076) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 03 03:49:44.731128 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-25aa7193-02de-4400-b85a-300415b08c4c tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:44.732306 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-25aa7193-02de-4400-b85a-300415b08c4c tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:44.733732 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-25aa7193-02de-4400-b85a-300415b08c4c tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:44.734180 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-25aa7193-02de-4400-b85a-300415b08c4c tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:44.734750 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-25aa7193-02de-4400-b85a-300415b08c4c tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:44.753018 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-e647ecc5-fc48-4e09-bc2a-768bb74e6ada None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214633 Sep 03 03:49:44.754030 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 65/117] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:49:44.807430 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-70e2e6a5-f84a-4e13-b02d-17a30ce06763 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:44.808364 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-70e2e6a5-f84a-4e13-b02d-17a30ce06763 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:44.815661 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-70e2e6a5-f84a-4e13-b02d-17a30ce06763 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:44.816286 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-70e2e6a5-f84a-4e13-b02d-17a30ce06763 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:44.817634 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-70e2e6a5-f84a-4e13-b02d-17a30ce06763 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:44.818542 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-70e2e6a5-f84a-4e13-b02d-17a30ce06763 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:44.819132 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-70e2e6a5-f84a-4e13-b02d-17a30ce06763 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:44.819739 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-70e2e6a5-f84a-4e13-b02d-17a30ce06763 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:45.472751 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-25aa7193-02de-4400-b85a-300415b08c4c tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:45.482766 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-25aa7193-02de-4400-b85a-300415b08c4c tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911" status: 200 len: 1365 microversion: 2.1 time: 0.766398 Sep 03 03:49:45.483714 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 53/118] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:44 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 => generated 1365 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:45.553758 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-30458d19-309a-4df5-8e1e-502ae6b52e9b req-f4e7deae-81ab-431d-9a64-cdb163955279 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "828bd786-6e99-4ccd-a4aa-9198ef8c8731", "tag": "c131716e-c4cf-4300-99d4-32cea2b1becb"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:49:45.570097 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-30458d19-309a-4df5-8e1e-502ae6b52e9b req-f4e7deae-81ab-431d-9a64-cdb163955279 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:45.570571 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-30458d19-309a-4df5-8e1e-502ae6b52e9b req-f4e7deae-81ab-431d-9a64-cdb163955279 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:45.571072 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-30458d19-309a-4df5-8e1e-502ae6b52e9b req-f4e7deae-81ab-431d-9a64-cdb163955279 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:45.594758 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-30458d19-309a-4df5-8e1e-502ae6b52e9b req-f4e7deae-81ab-431d-9a64-cdb163955279 service nova] Creating event network-changed:c131716e-c4cf-4300-99d4-32cea2b1becb for instance 828bd786-6e99-4ccd-a4aa-9198ef8c8731 on hv-cinder-79966 Sep 03 03:49:45.595303 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-30458d19-309a-4df5-8e1e-502ae6b52e9b req-f4e7deae-81ab-431d-9a64-cdb163955279 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132077) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 03 03:49:45.595690 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-30458d19-309a-4df5-8e1e-502ae6b52e9b req-f4e7deae-81ab-431d-9a64-cdb163955279 service nova] Acquired lock "compute-rpcapi-router" {{(pid=132077) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 03 03:49:45.596709 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4cae84b7-38da-465e-9a98-dff13e8deef2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:45.597229 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4cae84b7-38da-465e-9a98-dff13e8deef2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:45.597653 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4cae84b7-38da-465e-9a98-dff13e8deef2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:45.598351 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4cae84b7-38da-465e-9a98-dff13e8deef2 None None] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:45.598792 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4cae84b7-38da-465e-9a98-dff13e8deef2 None None] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:45.599227 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4cae84b7-38da-465e-9a98-dff13e8deef2 None None] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:45.608657 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.compute.rpcapi [None req-4cae84b7-38da-465e-9a98-dff13e8deef2 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 03 03:49:45.609595 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4cae84b7-38da-465e-9a98-dff13e8deef2 None None] Releasing lock "compute-rpcapi-router" {{(pid=132077) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 03 03:49:45.626943 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-4cae84b7-38da-465e-9a98-dff13e8deef2 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141700 Sep 03 03:49:45.627561 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 54/119] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:49:45.632995 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-8c0e312d-9843-4866-8779-c307c6fb72d7 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:45.633680 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-8c0e312d-9843-4866-8779-c307c6fb72d7 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:45.641716 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8c0e312d-9843-4866-8779-c307c6fb72d7 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:45.642464 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8c0e312d-9843-4866-8779-c307c6fb72d7 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:45.643028 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8c0e312d-9843-4866-8779-c307c6fb72d7 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:45.643784 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8c0e312d-9843-4866-8779-c307c6fb72d7 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:45.644308 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8c0e312d-9843-4866-8779-c307c6fb72d7 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:45.644841 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8c0e312d-9843-4866-8779-c307c6fb72d7 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:45.725972 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-70e2e6a5-f84a-4e13-b02d-17a30ce06763 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:45.736436 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-70e2e6a5-f84a-4e13-b02d-17a30ce06763 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1364 microversion: 2.1 time: 0.933505 Sep 03 03:49:45.737836 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 66/120] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:44 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1364 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:49:45.744776 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-9bbc15eb-989c-4372-99ad-444b4008bef4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:45.745422 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-9bbc15eb-989c-4372-99ad-444b4008bef4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:45.752590 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9bbc15eb-989c-4372-99ad-444b4008bef4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:45.753428 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9bbc15eb-989c-4372-99ad-444b4008bef4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:45.754272 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9bbc15eb-989c-4372-99ad-444b4008bef4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:45.755441 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9bbc15eb-989c-4372-99ad-444b4008bef4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:45.756103 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9bbc15eb-989c-4372-99ad-444b4008bef4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:45.756603 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9bbc15eb-989c-4372-99ad-444b4008bef4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:45.908686 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-9bbc15eb-989c-4372-99ad-444b4008bef4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:45.927942 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-9bbc15eb-989c-4372-99ad-444b4008bef4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:45.929773 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-9bbc15eb-989c-4372-99ad-444b4008bef4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:45.931268 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-9bbc15eb-989c-4372-99ad-444b4008bef4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1339 microversion: 2.20 time: 0.191999 Sep 03 03:49:45.932058 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 67/121] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:49:45 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1339 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:49:45.947092 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-f78d46d0-867e-46a9-9f6c-eadb9da11cd2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:45.947092 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-f78d46d0-867e-46a9-9f6c-eadb9da11cd2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:45.954610 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f78d46d0-867e-46a9-9f6c-eadb9da11cd2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:45.955225 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f78d46d0-867e-46a9-9f6c-eadb9da11cd2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:45.955786 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f78d46d0-867e-46a9-9f6c-eadb9da11cd2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:45.957357 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f78d46d0-867e-46a9-9f6c-eadb9da11cd2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:45.957934 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f78d46d0-867e-46a9-9f6c-eadb9da11cd2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:45.958637 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f78d46d0-867e-46a9-9f6c-eadb9da11cd2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:46.057087 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-8c0e312d-9843-4866-8779-c307c6fb72d7 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a959dec6c0c944aea231b65612892705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968cc9376f884f67b20b91547211fffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:46.065085 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-8c0e312d-9843-4866-8779-c307c6fb72d7 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 200 len: 1314 microversion: 2.1 time: 0.435961 Sep 03 03:49:46.082147 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 55/122] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:45 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:46.220081 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-f78d46d0-867e-46a9-9f6c-eadb9da11cd2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:46.229266 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-f78d46d0-867e-46a9-9f6c-eadb9da11cd2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1321 microversion: 2.1 time: 0.295511 Sep 03 03:49:46.230231 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 68/123] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:45 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1321 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:46.505801 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-c5cef73c-e22f-4d53-95ab-0d4cb0ba5b83 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:46.507548 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-c5cef73c-e22f-4d53-95ab-0d4cb0ba5b83 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:46.514342 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c5cef73c-e22f-4d53-95ab-0d4cb0ba5b83 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:46.515349 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c5cef73c-e22f-4d53-95ab-0d4cb0ba5b83 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:46.516035 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c5cef73c-e22f-4d53-95ab-0d4cb0ba5b83 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:46.516815 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c5cef73c-e22f-4d53-95ab-0d4cb0ba5b83 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:46.517488 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c5cef73c-e22f-4d53-95ab-0d4cb0ba5b83 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:46.517998 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c5cef73c-e22f-4d53-95ab-0d4cb0ba5b83 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:46.674071 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-c5cef73c-e22f-4d53-95ab-0d4cb0ba5b83 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:46.683996 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-c5cef73c-e22f-4d53-95ab-0d4cb0ba5b83 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911" status: 200 len: 1365 microversion: 2.1 time: 0.182064 Sep 03 03:49:46.684574 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 56/124] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:46 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:46.767495 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-adc8acf3-495f-4065-814b-85afd00b19ea tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:46.768097 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-adc8acf3-495f-4065-814b-85afd00b19ea tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:46.778650 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-adc8acf3-495f-4065-814b-85afd00b19ea tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:46.779498 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-adc8acf3-495f-4065-814b-85afd00b19ea tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:46.780187 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-adc8acf3-495f-4065-814b-85afd00b19ea tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:46.781083 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-adc8acf3-495f-4065-814b-85afd00b19ea tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:46.781939 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-adc8acf3-495f-4065-814b-85afd00b19ea tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:46.782535 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-adc8acf3-495f-4065-814b-85afd00b19ea tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:46.955603 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-c470bca6-d2a7-491f-a0fd-3abe57cc70f7 req-f7ceb004-edf5-4f01-8d0b-f46f968f600d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7f92467-64ec-4eba-af52-ad4923543504", "tag": "41a7b1ba-2a3f-4b4f-8d13-1e07765177c0"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:49:46.975374 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-c470bca6-d2a7-491f-a0fd-3abe57cc70f7 req-f7ceb004-edf5-4f01-8d0b-f46f968f600d service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:46.978137 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-c470bca6-d2a7-491f-a0fd-3abe57cc70f7 req-f7ceb004-edf5-4f01-8d0b-f46f968f600d service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:46.978977 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-c470bca6-d2a7-491f-a0fd-3abe57cc70f7 req-f7ceb004-edf5-4f01-8d0b-f46f968f600d service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:47.007008 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-c470bca6-d2a7-491f-a0fd-3abe57cc70f7 req-f7ceb004-edf5-4f01-8d0b-f46f968f600d service nova] Creating event network-changed:41a7b1ba-2a3f-4b4f-8d13-1e07765177c0 for instance f7f92467-64ec-4eba-af52-ad4923543504 on hv-cinder-79966 Sep 03 03:49:47.013457 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-c470bca6-d2a7-491f-a0fd-3abe57cc70f7 req-f7ceb004-edf5-4f01-8d0b-f46f968f600d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063056 Sep 03 03:49:47.016823 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 57/125] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:49:47.023649 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-9145b69c-5b35-460c-9b8a-5571aa87b11c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:47.025545 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-9145b69c-5b35-460c-9b8a-5571aa87b11c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:47.036639 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9145b69c-5b35-460c-9b8a-5571aa87b11c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:47.041310 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9145b69c-5b35-460c-9b8a-5571aa87b11c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:47.042316 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9145b69c-5b35-460c-9b8a-5571aa87b11c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:47.043395 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9145b69c-5b35-460c-9b8a-5571aa87b11c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:47.044526 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9145b69c-5b35-460c-9b8a-5571aa87b11c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:47.045161 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9145b69c-5b35-460c-9b8a-5571aa87b11c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:47.077512 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell1:SELECT=100 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:47.179056 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-adc8acf3-495f-4065-814b-85afd00b19ea tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:47.192718 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-adc8acf3-495f-4065-814b-85afd00b19ea tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1364 microversion: 2.1 time: 0.430189 Sep 03 03:49:47.214131 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 69/126] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:46 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1364 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:47.228985 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-cb22bd02-cd73-440c-a135-6ce10da17716 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:47.230167 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-cb22bd02-cd73-440c-a135-6ce10da17716 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:47.247068 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cb22bd02-cd73-440c-a135-6ce10da17716 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:47.247948 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cb22bd02-cd73-440c-a135-6ce10da17716 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:47.249007 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cb22bd02-cd73-440c-a135-6ce10da17716 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:47.250070 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cb22bd02-cd73-440c-a135-6ce10da17716 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:47.251612 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cb22bd02-cd73-440c-a135-6ce10da17716 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:47.252306 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cb22bd02-cd73-440c-a135-6ce10da17716 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:47.376741 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-9145b69c-5b35-460c-9b8a-5571aa87b11c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:47.386555 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-9145b69c-5b35-460c-9b8a-5571aa87b11c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:47.396480 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-9145b69c-5b35-460c-9b8a-5571aa87b11c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:47.398078 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-9145b69c-5b35-460c-9b8a-5571aa87b11c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1407 microversion: 2.20 time: 0.379683 Sep 03 03:49:47.413426 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 58/127] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:49:47 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1407 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:49:47.413426 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-a314bd38-930a-4376-ac7f-4bec156846dd tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:47.413426 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-a314bd38-930a-4376-ac7f-4bec156846dd tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:47.417250 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a314bd38-930a-4376-ac7f-4bec156846dd tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:47.417740 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a314bd38-930a-4376-ac7f-4bec156846dd tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:47.418171 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a314bd38-930a-4376-ac7f-4bec156846dd tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:47.418913 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a314bd38-930a-4376-ac7f-4bec156846dd tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:47.419428 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a314bd38-930a-4376-ac7f-4bec156846dd tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:47.419863 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a314bd38-930a-4376-ac7f-4bec156846dd tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:47.494079 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-cb22bd02-cd73-440c-a135-6ce10da17716 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a959dec6c0c944aea231b65612892705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968cc9376f884f67b20b91547211fffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:47.508102 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-cb22bd02-cd73-440c-a135-6ce10da17716 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 200 len: 1314 microversion: 2.1 time: 0.290381 Sep 03 03:49:47.508826 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 70/128] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:47 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:47.648560 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-eac97650-0d39-4cb6-bf48-8c08e6c7a038 req-c187cccd-b51d-43d1-bd9a-7ccd918d61f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5154156-831e-45fa-b20b-3c6bd4f1f383", "tag": "45d48f27-6986-4559-b518-e64ca4982470"}, {"name": "network-changed", "server_uuid": "5ab059eb-4353-4c86-91ae-089e1c35f387", "tag": "1dd4dd3b-d3d8-41d5-bd57-76720a2443c2"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:49:47.661930 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-eac97650-0d39-4cb6-bf48-8c08e6c7a038 req-c187cccd-b51d-43d1-bd9a-7ccd918d61f4 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:47.663829 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-eac97650-0d39-4cb6-bf48-8c08e6c7a038 req-c187cccd-b51d-43d1-bd9a-7ccd918d61f4 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:47.665306 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-eac97650-0d39-4cb6-bf48-8c08e6c7a038 req-c187cccd-b51d-43d1-bd9a-7ccd918d61f4 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:47.711598 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-eac97650-0d39-4cb6-bf48-8c08e6c7a038 req-c187cccd-b51d-43d1-bd9a-7ccd918d61f4 service nova] Creating event network-changed:45d48f27-6986-4559-b518-e64ca4982470 for instance e5154156-831e-45fa-b20b-3c6bd4f1f383 on hv-cinder-79966 Sep 03 03:49:47.712115 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-eac97650-0d39-4cb6-bf48-8c08e6c7a038 req-c187cccd-b51d-43d1-bd9a-7ccd918d61f4 service nova] Creating event network-changed:1dd4dd3b-d3d8-41d5-bd57-76720a2443c2 for instance 5ab059eb-4353-4c86-91ae-089e1c35f387 on hv-cinder-79966 Sep 03 03:49:47.738301 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-eac97650-0d39-4cb6-bf48-8c08e6c7a038 req-c187cccd-b51d-43d1-bd9a-7ccd918d61f4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.093495 Sep 03 03:49:47.742167 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 71/129] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 03:49:47.750656 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-0f7f5a14-7e27-419f-bf0c-1db3af898404 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:47.751366 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-0f7f5a14-7e27-419f-bf0c-1db3af898404 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:47.763981 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0f7f5a14-7e27-419f-bf0c-1db3af898404 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:47.785489 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0f7f5a14-7e27-419f-bf0c-1db3af898404 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:47.786508 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0f7f5a14-7e27-419f-bf0c-1db3af898404 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:47.789872 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0f7f5a14-7e27-419f-bf0c-1db3af898404 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:47.790336 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0f7f5a14-7e27-419f-bf0c-1db3af898404 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:47.792117 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0f7f5a14-7e27-419f-bf0c-1db3af898404 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:48.015613 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-0f7f5a14-7e27-419f-bf0c-1db3af898404 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:48.023961 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-0f7f5a14-7e27-419f-bf0c-1db3af898404 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911" status: 200 len: 1365 microversion: 2.1 time: 0.280276 Sep 03 03:49:48.024611 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 72/130] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:47 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 => generated 1365 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:48.218029 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-60e167bb-539b-41fc-8197-e80d8d459f88 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:48.219104 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-60e167bb-539b-41fc-8197-e80d8d459f88 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:48.240570 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-60e167bb-539b-41fc-8197-e80d8d459f88 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:48.241731 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-60e167bb-539b-41fc-8197-e80d8d459f88 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:48.243869 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-60e167bb-539b-41fc-8197-e80d8d459f88 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:48.245951 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-60e167bb-539b-41fc-8197-e80d8d459f88 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:48.247705 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-60e167bb-539b-41fc-8197-e80d8d459f88 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:48.249750 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-60e167bb-539b-41fc-8197-e80d8d459f88 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:48.250513 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a314bd38-930a-4376-ac7f-4bec156846dd tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:48.266040 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-a314bd38-930a-4376-ac7f-4bec156846dd tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1321 microversion: 2.1 time: 0.862053 Sep 03 03:49:48.267541 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 59/131] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:47 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1321 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:48.424484 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-a12bb7c0-81c2-4d91-96f2-5b2b6b8538df tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:48.425391 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-a12bb7c0-81c2-4d91-96f2-5b2b6b8538df tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:48.435681 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a12bb7c0-81c2-4d91-96f2-5b2b6b8538df tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:48.437566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a12bb7c0-81c2-4d91-96f2-5b2b6b8538df tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:48.438197 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a12bb7c0-81c2-4d91-96f2-5b2b6b8538df tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:48.438880 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a12bb7c0-81c2-4d91-96f2-5b2b6b8538df tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:48.439333 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a12bb7c0-81c2-4d91-96f2-5b2b6b8538df tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:48.439906 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a12bb7c0-81c2-4d91-96f2-5b2b6b8538df tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:48.527262 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-60e167bb-539b-41fc-8197-e80d8d459f88 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:48.535493 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-60e167bb-539b-41fc-8197-e80d8d459f88 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1364 microversion: 2.1 time: 0.322483 Sep 03 03:49:48.538056 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 73/132] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:48 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1364 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:48.542866 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-02009aec-3e8a-4fab-92e6-03f9c40304d4 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:48.543658 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-02009aec-3e8a-4fab-92e6-03f9c40304d4 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:48.550618 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-02009aec-3e8a-4fab-92e6-03f9c40304d4 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:48.551331 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-02009aec-3e8a-4fab-92e6-03f9c40304d4 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:48.551932 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-02009aec-3e8a-4fab-92e6-03f9c40304d4 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:48.553005 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-02009aec-3e8a-4fab-92e6-03f9c40304d4 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:48.553595 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-02009aec-3e8a-4fab-92e6-03f9c40304d4 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:48.554157 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-02009aec-3e8a-4fab-92e6-03f9c40304d4 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:48.655393 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a12bb7c0-81c2-4d91-96f2-5b2b6b8538df tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:48.666203 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a12bb7c0-81c2-4d91-96f2-5b2b6b8538df tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:48.668431 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a12bb7c0-81c2-4d91-96f2-5b2b6b8538df tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:48.670604 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-a12bb7c0-81c2-4d91-96f2-5b2b6b8538df tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1407 microversion: 2.20 time: 0.249758 Sep 03 03:49:48.672255 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 60/133] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:49:48 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:49:48.720156 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-02009aec-3e8a-4fab-92e6-03f9c40304d4 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a959dec6c0c944aea231b65612892705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968cc9376f884f67b20b91547211fffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:48.730369 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-02009aec-3e8a-4fab-92e6-03f9c40304d4 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 200 len: 1314 microversion: 2.1 time: 0.191109 Sep 03 03:49:48.730968 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 74/134] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:48 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:49.060492 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-df23fe4d-ca77-477e-8d43-66f3c4c16ab5 req-242234a1-1f3b-4169-8b0c-84e004312679 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d61f1c-d865-4d0d-89a9-1f91f0f8bf78", "tag": "dc502e70-8b66-4849-929e-0879ed88e591"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:49:49.060647 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-9f14a6c0-9453-4c62-b211-306610a0f05e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:49.060647 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-9f14a6c0-9453-4c62-b211-306610a0f05e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:49.061322 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-df23fe4d-ca77-477e-8d43-66f3c4c16ab5 req-242234a1-1f3b-4169-8b0c-84e004312679 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:49.061322 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-df23fe4d-ca77-477e-8d43-66f3c4c16ab5 req-242234a1-1f3b-4169-8b0c-84e004312679 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:49.061322 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-df23fe4d-ca77-477e-8d43-66f3c4c16ab5 req-242234a1-1f3b-4169-8b0c-84e004312679 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:49.061536 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9f14a6c0-9453-4c62-b211-306610a0f05e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:49.063884 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9f14a6c0-9453-4c62-b211-306610a0f05e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:49.064574 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9f14a6c0-9453-4c62-b211-306610a0f05e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:49.068527 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9f14a6c0-9453-4c62-b211-306610a0f05e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:49.069207 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9f14a6c0-9453-4c62-b211-306610a0f05e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:49.069780 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9f14a6c0-9453-4c62-b211-306610a0f05e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:49.073880 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-df23fe4d-ca77-477e-8d43-66f3c4c16ab5 req-242234a1-1f3b-4169-8b0c-84e004312679 service nova] Creating event network-changed:dc502e70-8b66-4849-929e-0879ed88e591 for instance 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 on hv-cinder-79966 Sep 03 03:49:49.079316 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-df23fe4d-ca77-477e-8d43-66f3c4c16ab5 req-242234a1-1f3b-4169-8b0c-84e004312679 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033805 Sep 03 03:49:49.079977 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 61/135] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 03:49:49.245383 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-9f14a6c0-9453-4c62-b211-306610a0f05e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:49.254055 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-9f14a6c0-9453-4c62-b211-306610a0f05e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911" status: 200 len: 1365 microversion: 2.1 time: 0.208688 Sep 03 03:49:49.254914 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 75/136] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:49 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:49.292639 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-32a5e8db-7535-4a43-a45b-6ca63f0fd2df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:49.293429 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-32a5e8db-7535-4a43-a45b-6ca63f0fd2df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:49.302241 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-32a5e8db-7535-4a43-a45b-6ca63f0fd2df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:49.302955 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-32a5e8db-7535-4a43-a45b-6ca63f0fd2df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:49.303529 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-32a5e8db-7535-4a43-a45b-6ca63f0fd2df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:49.304347 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-32a5e8db-7535-4a43-a45b-6ca63f0fd2df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:49.305335 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-32a5e8db-7535-4a43-a45b-6ca63f0fd2df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:49.306242 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-32a5e8db-7535-4a43-a45b-6ca63f0fd2df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:49.473566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-32a5e8db-7535-4a43-a45b-6ca63f0fd2df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:49.482835 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-32a5e8db-7535-4a43-a45b-6ca63f0fd2df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1321 microversion: 2.1 time: 0.194303 Sep 03 03:49:49.483407 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 62/137] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:49 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:49.564950 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-6445fb0a-eab0-41e9-83a7-ee3210ea5362 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:49.565601 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-6445fb0a-eab0-41e9-83a7-ee3210ea5362 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:49.573349 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6445fb0a-eab0-41e9-83a7-ee3210ea5362 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:49.574067 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6445fb0a-eab0-41e9-83a7-ee3210ea5362 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:49.574607 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6445fb0a-eab0-41e9-83a7-ee3210ea5362 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:49.575707 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6445fb0a-eab0-41e9-83a7-ee3210ea5362 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:49.576687 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6445fb0a-eab0-41e9-83a7-ee3210ea5362 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:49.577302 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6445fb0a-eab0-41e9-83a7-ee3210ea5362 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:49.696487 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-b76086f3-4a75-40e4-be08-19736b3ffff1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:49.697392 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-b76086f3-4a75-40e4-be08-19736b3ffff1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:49.704017 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b76086f3-4a75-40e4-be08-19736b3ffff1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:49.704988 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b76086f3-4a75-40e4-be08-19736b3ffff1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:49.705774 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b76086f3-4a75-40e4-be08-19736b3ffff1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:49.707074 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b76086f3-4a75-40e4-be08-19736b3ffff1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:49.707864 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b76086f3-4a75-40e4-be08-19736b3ffff1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:49.708457 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b76086f3-4a75-40e4-be08-19736b3ffff1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:49.731150 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-6445fb0a-eab0-41e9-83a7-ee3210ea5362 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:49.735979 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell1:SELECT=100 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:49.742726 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-6445fb0a-eab0-41e9-83a7-ee3210ea5362 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1364 microversion: 2.1 time: 0.182226 Sep 03 03:49:49.743348 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 76/138] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:49 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:49:49.761884 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-068f285a-79aa-4061-b2f0-43adc015df59 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:49.762468 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-068f285a-79aa-4061-b2f0-43adc015df59 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:49.769187 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-068f285a-79aa-4061-b2f0-43adc015df59 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:49.769658 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-068f285a-79aa-4061-b2f0-43adc015df59 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:49.770258 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-068f285a-79aa-4061-b2f0-43adc015df59 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:49.770996 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-068f285a-79aa-4061-b2f0-43adc015df59 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:49.771462 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-068f285a-79aa-4061-b2f0-43adc015df59 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:49.772029 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-068f285a-79aa-4061-b2f0-43adc015df59 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:49.910474 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-b76086f3-4a75-40e4-be08-19736b3ffff1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:49.920924 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-b76086f3-4a75-40e4-be08-19736b3ffff1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:49.922564 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-b76086f3-4a75-40e4-be08-19736b3ffff1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:49.923860 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-b76086f3-4a75-40e4-be08-19736b3ffff1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1407 microversion: 2.20 time: 0.231275 Sep 03 03:49:49.925125 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 63/139] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:49:49 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 03:49:49.930276 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-068f285a-79aa-4061-b2f0-43adc015df59 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a959dec6c0c944aea231b65612892705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968cc9376f884f67b20b91547211fffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:49.942160 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-068f285a-79aa-4061-b2f0-43adc015df59 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 200 len: 1314 microversion: 2.1 time: 0.184802 Sep 03 03:49:49.943558 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 77/140] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:49 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:50.282881 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-243f7d0e-a8e5-42cf-a985-80551265d74c tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:50.283680 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-243f7d0e-a8e5-42cf-a985-80551265d74c tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:50.317678 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-243f7d0e-a8e5-42cf-a985-80551265d74c tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:50.318390 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-243f7d0e-a8e5-42cf-a985-80551265d74c tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:50.320158 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-243f7d0e-a8e5-42cf-a985-80551265d74c tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:50.321368 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-243f7d0e-a8e5-42cf-a985-80551265d74c tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:50.322111 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-243f7d0e-a8e5-42cf-a985-80551265d74c tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:50.325021 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-243f7d0e-a8e5-42cf-a985-80551265d74c tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:50.571318 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-9275dc44-6f1a-478e-a128-7d48508fd505 req-0174c0eb-315c-4974-8c24-076e468222f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69fe618d-1192-4541-9d90-e5cee06be911", "name": "network-vif-plugged", "status": "completed", "tag": "1197b605-d728-4d04-90d2-9befd8120dd4"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:49:50.591347 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-9275dc44-6f1a-478e-a128-7d48508fd505 req-0174c0eb-315c-4974-8c24-076e468222f5 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:50.591826 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-9275dc44-6f1a-478e-a128-7d48508fd505 req-0174c0eb-315c-4974-8c24-076e468222f5 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:50.592326 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-9275dc44-6f1a-478e-a128-7d48508fd505 req-0174c0eb-315c-4974-8c24-076e468222f5 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:50.614376 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-9275dc44-6f1a-478e-a128-7d48508fd505 req-0174c0eb-315c-4974-8c24-076e468222f5 service nova] Creating event network-vif-plugged:1197b605-d728-4d04-90d2-9befd8120dd4 for instance 69fe618d-1192-4541-9d90-e5cee06be911 on hv-cinder-79966 Sep 03 03:49:50.626798 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-9275dc44-6f1a-478e-a128-7d48508fd505 req-0174c0eb-315c-4974-8c24-076e468222f5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.347979 Sep 03 03:49:50.627839 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 64/141] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:49:50.639872 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-b492fb7a-7fe8-414c-9d72-9980c010a27a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:50.643746 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-b492fb7a-7fe8-414c-9d72-9980c010a27a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:50.658907 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b492fb7a-7fe8-414c-9d72-9980c010a27a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:50.659775 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b492fb7a-7fe8-414c-9d72-9980c010a27a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:50.661024 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b492fb7a-7fe8-414c-9d72-9980c010a27a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:50.663640 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b492fb7a-7fe8-414c-9d72-9980c010a27a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:50.664286 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b492fb7a-7fe8-414c-9d72-9980c010a27a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:50.665593 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b492fb7a-7fe8-414c-9d72-9980c010a27a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:51.157544 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-243f7d0e-a8e5-42cf-a985-80551265d74c tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:51.165222 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-243f7d0e-a8e5-42cf-a985-80551265d74c tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911" status: 200 len: 1365 microversion: 2.1 time: 0.887860 Sep 03 03:49:51.165817 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 78/142] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:50 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 => generated 1365 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:51.170652 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-402761f6-935b-4e05-babd-84e9275fecb1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:51.171337 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-402761f6-935b-4e05-babd-84e9275fecb1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:51.189419 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-402761f6-935b-4e05-babd-84e9275fecb1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:51.189895 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-402761f6-935b-4e05-babd-84e9275fecb1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:51.190387 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-402761f6-935b-4e05-babd-84e9275fecb1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:51.191155 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-402761f6-935b-4e05-babd-84e9275fecb1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:51.191596 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-402761f6-935b-4e05-babd-84e9275fecb1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:51.192013 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-402761f6-935b-4e05-babd-84e9275fecb1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:51.227273 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-b492fb7a-7fe8-414c-9d72-9980c010a27a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:51.235497 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-b492fb7a-7fe8-414c-9d72-9980c010a27a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1321 microversion: 2.1 time: 0.606281 Sep 03 03:49:51.239495 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 65/143] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:50 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1321 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:51.255387 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-e13d1dd1-d3ec-4ea1-bfa3-984d5c05d32c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:51.255997 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-e13d1dd1-d3ec-4ea1-bfa3-984d5c05d32c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:51.264224 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e13d1dd1-d3ec-4ea1-bfa3-984d5c05d32c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:51.264701 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e13d1dd1-d3ec-4ea1-bfa3-984d5c05d32c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:51.265119 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e13d1dd1-d3ec-4ea1-bfa3-984d5c05d32c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:51.266055 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e13d1dd1-d3ec-4ea1-bfa3-984d5c05d32c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:51.266503 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e13d1dd1-d3ec-4ea1-bfa3-984d5c05d32c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:51.266964 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e13d1dd1-d3ec-4ea1-bfa3-984d5c05d32c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:51.533171 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-e13d1dd1-d3ec-4ea1-bfa3-984d5c05d32c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:51.545123 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-e13d1dd1-d3ec-4ea1-bfa3-984d5c05d32c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:51.549493 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-e13d1dd1-d3ec-4ea1-bfa3-984d5c05d32c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:51.551051 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-e13d1dd1-d3ec-4ea1-bfa3-984d5c05d32c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1407 microversion: 2.20 time: 0.310405 Sep 03 03:49:51.551752 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 66/144] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:49:51 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1407 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:49:51.568505 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-30544aa7-c941-4d87-b3e4-37aca994cd7e tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:51.570837 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-30544aa7-c941-4d87-b3e4-37aca994cd7e tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:51.578578 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-30544aa7-c941-4d87-b3e4-37aca994cd7e tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:51.579750 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-30544aa7-c941-4d87-b3e4-37aca994cd7e tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:51.580377 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-30544aa7-c941-4d87-b3e4-37aca994cd7e tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:51.581120 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-30544aa7-c941-4d87-b3e4-37aca994cd7e tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:51.581778 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-30544aa7-c941-4d87-b3e4-37aca994cd7e tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:51.582470 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-30544aa7-c941-4d87-b3e4-37aca994cd7e tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:51.613542 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-402761f6-935b-4e05-babd-84e9275fecb1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:51.624204 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-402761f6-935b-4e05-babd-84e9275fecb1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1364 microversion: 2.1 time: 0.456394 Sep 03 03:49:51.625807 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 79/145] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:51 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1364 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:51.764588 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-30544aa7-c941-4d87-b3e4-37aca994cd7e tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a959dec6c0c944aea231b65612892705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968cc9376f884f67b20b91547211fffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:51.772268 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-30544aa7-c941-4d87-b3e4-37aca994cd7e tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 200 len: 1314 microversion: 2.1 time: 0.219093 Sep 03 03:49:51.773026 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 67/146] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:51 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:52.189582 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-c388da05-b226-4f65-bdd2-bccc61483a52 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:52.190324 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-c388da05-b226-4f65-bdd2-bccc61483a52 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:52.196426 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c388da05-b226-4f65-bdd2-bccc61483a52 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:52.197089 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c388da05-b226-4f65-bdd2-bccc61483a52 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:52.197608 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c388da05-b226-4f65-bdd2-bccc61483a52 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:52.198394 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c388da05-b226-4f65-bdd2-bccc61483a52 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:52.198967 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c388da05-b226-4f65-bdd2-bccc61483a52 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:52.199502 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c388da05-b226-4f65-bdd2-bccc61483a52 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:52.262685 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-f0f7efd9-b7a3-4046-b117-19fca2321697 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:52.263317 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-f0f7efd9-b7a3-4046-b117-19fca2321697 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:52.270345 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f0f7efd9-b7a3-4046-b117-19fca2321697 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:52.270852 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f0f7efd9-b7a3-4046-b117-19fca2321697 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:52.271269 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f0f7efd9-b7a3-4046-b117-19fca2321697 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:52.272142 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f0f7efd9-b7a3-4046-b117-19fca2321697 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:52.272587 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f0f7efd9-b7a3-4046-b117-19fca2321697 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:52.273002 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f0f7efd9-b7a3-4046-b117-19fca2321697 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:52.366573 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-c388da05-b226-4f65-bdd2-bccc61483a52 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:52.379628 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-c388da05-b226-4f65-bdd2-bccc61483a52 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911" status: 200 len: 1365 microversion: 2.1 time: 0.194292 Sep 03 03:49:52.380266 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 80/147] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:52 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:52.459242 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-f0f7efd9-b7a3-4046-b117-19fca2321697 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:52.470271 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-f0f7efd9-b7a3-4046-b117-19fca2321697 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1321 microversion: 2.1 time: 0.211212 Sep 03 03:49:52.471420 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 68/148] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:52 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:49:52.577744 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-f294805a-814c-4e6a-b162-9f02e1ad3ddd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:52.579285 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-f294805a-814c-4e6a-b162-9f02e1ad3ddd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:52.586667 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f294805a-814c-4e6a-b162-9f02e1ad3ddd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:52.587211 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f294805a-814c-4e6a-b162-9f02e1ad3ddd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:52.587661 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f294805a-814c-4e6a-b162-9f02e1ad3ddd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:52.588819 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f294805a-814c-4e6a-b162-9f02e1ad3ddd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:52.589345 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f294805a-814c-4e6a-b162-9f02e1ad3ddd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:52.589764 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f294805a-814c-4e6a-b162-9f02e1ad3ddd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:52.649721 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-a0da4800-90f6-4187-8494-55f6a7074b48 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:52.651338 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-a0da4800-90f6-4187-8494-55f6a7074b48 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:52.660422 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a0da4800-90f6-4187-8494-55f6a7074b48 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:52.661588 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a0da4800-90f6-4187-8494-55f6a7074b48 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:52.662229 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a0da4800-90f6-4187-8494-55f6a7074b48 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:52.663218 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a0da4800-90f6-4187-8494-55f6a7074b48 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:52.663876 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a0da4800-90f6-4187-8494-55f6a7074b48 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:52.664669 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a0da4800-90f6-4187-8494-55f6a7074b48 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:52.817675 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-f294805a-814c-4e6a-b162-9f02e1ad3ddd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:52.826300 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-f294805a-814c-4e6a-b162-9f02e1ad3ddd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:52.828046 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-f294805a-814c-4e6a-b162-9f02e1ad3ddd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:52.829366 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-f294805a-814c-4e6a-b162-9f02e1ad3ddd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1407 microversion: 2.20 time: 0.255923 Sep 03 03:49:52.830410 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 81/149] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:49:52 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1407 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:49:52.835419 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-6e133791-7683-40b5-9f19-d0a3908ae3ed req-99565b37-d67f-4985-8d4f-9956a17db835 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ab059eb-4353-4c86-91ae-089e1c35f387", "name": "network-vif-plugged", "status": "completed", "tag": "1dd4dd3b-d3d8-41d5-bd57-76720a2443c2"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:49:52.845967 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-6e133791-7683-40b5-9f19-d0a3908ae3ed req-99565b37-d67f-4985-8d4f-9956a17db835 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:52.846549 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-6e133791-7683-40b5-9f19-d0a3908ae3ed req-99565b37-d67f-4985-8d4f-9956a17db835 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:52.847138 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-6e133791-7683-40b5-9f19-d0a3908ae3ed req-99565b37-d67f-4985-8d4f-9956a17db835 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:52.859002 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-6e133791-7683-40b5-9f19-d0a3908ae3ed req-99565b37-d67f-4985-8d4f-9956a17db835 service nova] Creating event network-vif-plugged:1dd4dd3b-d3d8-41d5-bd57-76720a2443c2 for instance 5ab059eb-4353-4c86-91ae-089e1c35f387 on hv-cinder-79966 Sep 03 03:49:52.864311 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-6e133791-7683-40b5-9f19-d0a3908ae3ed req-99565b37-d67f-4985-8d4f-9956a17db835 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032474 Sep 03 03:49:52.865089 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 82/150] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:49:52.870612 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-0074dd21-fbf8-42a0-9d6e-6c26188d3a8f tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:52.871286 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-0074dd21-fbf8-42a0-9d6e-6c26188d3a8f tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:52.877634 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0074dd21-fbf8-42a0-9d6e-6c26188d3a8f tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:52.878210 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0074dd21-fbf8-42a0-9d6e-6c26188d3a8f tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:52.878573 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0074dd21-fbf8-42a0-9d6e-6c26188d3a8f tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:52.879626 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0074dd21-fbf8-42a0-9d6e-6c26188d3a8f tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:52.880232 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0074dd21-fbf8-42a0-9d6e-6c26188d3a8f tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:52.880828 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0074dd21-fbf8-42a0-9d6e-6c26188d3a8f tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:52.917976 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a0da4800-90f6-4187-8494-55f6a7074b48 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:52.930536 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-a0da4800-90f6-4187-8494-55f6a7074b48 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1364 microversion: 2.1 time: 0.285624 Sep 03 03:49:52.931148 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 69/151] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:52 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1364 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:53.344967 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-0074dd21-fbf8-42a0-9d6e-6c26188d3a8f tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a959dec6c0c944aea231b65612892705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968cc9376f884f67b20b91547211fffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:53.355805 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-0074dd21-fbf8-42a0-9d6e-6c26188d3a8f tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 200 len: 1314 microversion: 2.1 time: 0.489403 Sep 03 03:49:53.356571 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 83/152] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:52 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:53.413425 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-9c6eb425-0c4a-44fb-bcd6-686630fdc8a7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:53.414091 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-9c6eb425-0c4a-44fb-bcd6-686630fdc8a7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:53.421565 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9c6eb425-0c4a-44fb-bcd6-686630fdc8a7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:53.422155 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9c6eb425-0c4a-44fb-bcd6-686630fdc8a7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:53.422639 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9c6eb425-0c4a-44fb-bcd6-686630fdc8a7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:53.423586 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9c6eb425-0c4a-44fb-bcd6-686630fdc8a7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:53.424231 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9c6eb425-0c4a-44fb-bcd6-686630fdc8a7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:53.424706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9c6eb425-0c4a-44fb-bcd6-686630fdc8a7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:53.496984 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-af04aa32-f85b-4565-8838-f04ef30dd990 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:53.497701 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-af04aa32-f85b-4565-8838-f04ef30dd990 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:53.505271 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-af04aa32-f85b-4565-8838-f04ef30dd990 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:53.505762 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-af04aa32-f85b-4565-8838-f04ef30dd990 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:53.506187 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-af04aa32-f85b-4565-8838-f04ef30dd990 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:53.507076 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-af04aa32-f85b-4565-8838-f04ef30dd990 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:53.507675 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-af04aa32-f85b-4565-8838-f04ef30dd990 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:53.508277 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-af04aa32-f85b-4565-8838-f04ef30dd990 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:53.613160 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-9c6eb425-0c4a-44fb-bcd6-686630fdc8a7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:53.629370 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-9c6eb425-0c4a-44fb-bcd6-686630fdc8a7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911" status: 200 len: 1365 microversion: 2.1 time: 0.225041 Sep 03 03:49:53.631060 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 70/153] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:53 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 => generated 1365 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:53.856996 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-c2338b58-a32b-449a-8a97-8252661c0db2 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:53.858075 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-c2338b58-a32b-449a-8a97-8252661c0db2 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:53.864444 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c2338b58-a32b-449a-8a97-8252661c0db2 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:53.864964 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c2338b58-a32b-449a-8a97-8252661c0db2 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:53.865365 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c2338b58-a32b-449a-8a97-8252661c0db2 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:53.866239 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c2338b58-a32b-449a-8a97-8252661c0db2 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:53.866673 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c2338b58-a32b-449a-8a97-8252661c0db2 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:53.867154 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c2338b58-a32b-449a-8a97-8252661c0db2 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:54.035690 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-c2338b58-a32b-449a-8a97-8252661c0db2 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:54.049651 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-c2338b58-a32b-449a-8a97-8252661c0db2 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:54.051655 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-c2338b58-a32b-449a-8a97-8252661c0db2 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:54.053580 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-c2338b58-a32b-449a-8a97-8252661c0db2 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1407 microversion: 2.20 time: 0.200154 Sep 03 03:49:54.054593 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 71/154] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:49:53 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 03:49:54.061543 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-1b9a9e1a-0c15-4283-be0c-a8855cad7009 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:54.062382 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-1b9a9e1a-0c15-4283-be0c-a8855cad7009 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:54.070036 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1b9a9e1a-0c15-4283-be0c-a8855cad7009 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:54.071110 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1b9a9e1a-0c15-4283-be0c-a8855cad7009 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:54.071773 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1b9a9e1a-0c15-4283-be0c-a8855cad7009 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:54.072760 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1b9a9e1a-0c15-4283-be0c-a8855cad7009 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:54.073690 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1b9a9e1a-0c15-4283-be0c-a8855cad7009 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:54.074438 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1b9a9e1a-0c15-4283-be0c-a8855cad7009 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:54.120787 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-af04aa32-f85b-4565-8838-f04ef30dd990 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:54.132064 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-af04aa32-f85b-4565-8838-f04ef30dd990 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1321 microversion: 2.1 time: 0.642015 Sep 03 03:49:54.133063 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 84/155] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:53 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1321 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:54.224612 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-1b9a9e1a-0c15-4283-be0c-a8855cad7009 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:54.232845 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-1b9a9e1a-0c15-4283-be0c-a8855cad7009 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1364 microversion: 2.1 time: 0.175742 Sep 03 03:49:54.233608 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 72/156] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:54 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:54.382789 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-d8e6f184-d6ec-4668-830f-ef918e2fe614 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:54.383882 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-d8e6f184-d6ec-4668-830f-ef918e2fe614 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:54.391273 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d8e6f184-d6ec-4668-830f-ef918e2fe614 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:54.391754 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d8e6f184-d6ec-4668-830f-ef918e2fe614 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:54.392176 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d8e6f184-d6ec-4668-830f-ef918e2fe614 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:54.392868 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d8e6f184-d6ec-4668-830f-ef918e2fe614 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:54.393411 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d8e6f184-d6ec-4668-830f-ef918e2fe614 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:54.393872 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d8e6f184-d6ec-4668-830f-ef918e2fe614 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:54.538203 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-d8e6f184-d6ec-4668-830f-ef918e2fe614 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a959dec6c0c944aea231b65612892705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968cc9376f884f67b20b91547211fffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:54.547896 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-d8e6f184-d6ec-4668-830f-ef918e2fe614 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 200 len: 1314 microversion: 2.1 time: 0.170124 Sep 03 03:49:54.548721 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 85/157] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:54 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:54.656664 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-44b67129-1343-4a22-88af-ac38316f31e8 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:54.657248 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-44b67129-1343-4a22-88af-ac38316f31e8 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:54.664278 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-44b67129-1343-4a22-88af-ac38316f31e8 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:54.664759 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-44b67129-1343-4a22-88af-ac38316f31e8 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:54.665179 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-44b67129-1343-4a22-88af-ac38316f31e8 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:54.665917 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-44b67129-1343-4a22-88af-ac38316f31e8 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:54.666408 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-44b67129-1343-4a22-88af-ac38316f31e8 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:54.666833 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-44b67129-1343-4a22-88af-ac38316f31e8 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:54.810306 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-44b67129-1343-4a22-88af-ac38316f31e8 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:54.819194 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-44b67129-1343-4a22-88af-ac38316f31e8 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911" status: 200 len: 1365 microversion: 2.1 time: 0.166301 Sep 03 03:49:54.819744 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 73/158] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:54 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:54.881893 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-70c942bd-0dfc-4782-aa12-3b91270f39ca req-b78c0b54-c600-4542-a6ac-fb3f76e610e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f92467-64ec-4eba-af52-ad4923543504", "name": "network-vif-plugged", "status": "completed", "tag": "41a7b1ba-2a3f-4b4f-8d13-1e07765177c0"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:49:54.887932 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell0:SELECT=2 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:54.894672 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-70c942bd-0dfc-4782-aa12-3b91270f39ca req-b78c0b54-c600-4542-a6ac-fb3f76e610e6 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:54.895178 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-70c942bd-0dfc-4782-aa12-3b91270f39ca req-b78c0b54-c600-4542-a6ac-fb3f76e610e6 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:54.895827 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-70c942bd-0dfc-4782-aa12-3b91270f39ca req-b78c0b54-c600-4542-a6ac-fb3f76e610e6 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:54.912342 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-70c942bd-0dfc-4782-aa12-3b91270f39ca req-b78c0b54-c600-4542-a6ac-fb3f76e610e6 service nova] Creating event network-vif-plugged:41a7b1ba-2a3f-4b4f-8d13-1e07765177c0 for instance f7f92467-64ec-4eba-af52-ad4923543504 on hv-cinder-79966 Sep 03 03:49:54.917185 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-70c942bd-0dfc-4782-aa12-3b91270f39ca req-b78c0b54-c600-4542-a6ac-fb3f76e610e6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039121 Sep 03 03:49:54.917777 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 86/159] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:49:55.079585 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-a813d365-2ba3-4bf3-91f7-04715e9f7d39 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:55.080903 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-a813d365-2ba3-4bf3-91f7-04715e9f7d39 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:55.088245 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a813d365-2ba3-4bf3-91f7-04715e9f7d39 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:55.088756 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a813d365-2ba3-4bf3-91f7-04715e9f7d39 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:55.089182 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a813d365-2ba3-4bf3-91f7-04715e9f7d39 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:55.089874 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a813d365-2ba3-4bf3-91f7-04715e9f7d39 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:55.090385 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a813d365-2ba3-4bf3-91f7-04715e9f7d39 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:55.090727 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a813d365-2ba3-4bf3-91f7-04715e9f7d39 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:55.159024 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-52f46987-a217-41f0-9f3e-2eff3c13db1c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:55.160980 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-52f46987-a217-41f0-9f3e-2eff3c13db1c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:55.169858 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-52f46987-a217-41f0-9f3e-2eff3c13db1c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:55.170868 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-52f46987-a217-41f0-9f3e-2eff3c13db1c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:55.171302 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-52f46987-a217-41f0-9f3e-2eff3c13db1c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:55.172199 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-52f46987-a217-41f0-9f3e-2eff3c13db1c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:55.172816 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-52f46987-a217-41f0-9f3e-2eff3c13db1c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:55.173385 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-52f46987-a217-41f0-9f3e-2eff3c13db1c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:55.242699 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a813d365-2ba3-4bf3-91f7-04715e9f7d39 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:55.251054 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a813d365-2ba3-4bf3-91f7-04715e9f7d39 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:55.252899 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a813d365-2ba3-4bf3-91f7-04715e9f7d39 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:55.254161 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-a813d365-2ba3-4bf3-91f7-04715e9f7d39 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1407 microversion: 2.20 time: 0.178914 Sep 03 03:49:55.254745 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 74/160] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:49:55 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:49:55.259361 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-10b27831-f820-4ecb-98d3-24b10b20ed2a tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:55.260165 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-10b27831-f820-4ecb-98d3-24b10b20ed2a tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:55.266774 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-10b27831-f820-4ecb-98d3-24b10b20ed2a tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:55.267287 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-10b27831-f820-4ecb-98d3-24b10b20ed2a tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:55.267715 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-10b27831-f820-4ecb-98d3-24b10b20ed2a tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:55.268517 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-10b27831-f820-4ecb-98d3-24b10b20ed2a tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:55.268886 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-10b27831-f820-4ecb-98d3-24b10b20ed2a tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:55.269467 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-10b27831-f820-4ecb-98d3-24b10b20ed2a tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:55.329819 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-52f46987-a217-41f0-9f3e-2eff3c13db1c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:55.341975 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-52f46987-a217-41f0-9f3e-2eff3c13db1c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1321 microversion: 2.1 time: 0.187588 Sep 03 03:49:55.342573 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 87/161] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:55 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:49:55.406928 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-10b27831-f820-4ecb-98d3-24b10b20ed2a tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:55.416827 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-10b27831-f820-4ecb-98d3-24b10b20ed2a tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1364 microversion: 2.1 time: 0.160843 Sep 03 03:49:55.417599 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 75/162] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:55 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:55.576530 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-9be24556-832b-4384-a513-ab86463800bb tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:55.577131 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-9be24556-832b-4384-a513-ab86463800bb tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:55.584440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9be24556-832b-4384-a513-ab86463800bb tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:55.584941 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9be24556-832b-4384-a513-ab86463800bb tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:55.585431 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9be24556-832b-4384-a513-ab86463800bb tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:55.586068 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9be24556-832b-4384-a513-ab86463800bb tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:55.586504 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9be24556-832b-4384-a513-ab86463800bb tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:55.586954 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9be24556-832b-4384-a513-ab86463800bb tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:55.728607 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-9be24556-832b-4384-a513-ab86463800bb tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a959dec6c0c944aea231b65612892705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968cc9376f884f67b20b91547211fffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:55.739304 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-9be24556-832b-4384-a513-ab86463800bb tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 200 len: 1314 microversion: 2.1 time: 0.166738 Sep 03 03:49:55.739898 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 88/163] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:55 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:49:55.844757 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-dd3ae231-ba94-4dc3-9ec5-0a0188e30b63 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:55.845280 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-dd3ae231-ba94-4dc3-9ec5-0a0188e30b63 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:55.848063 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell0:SELECT=2 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:55.855801 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-dd3ae231-ba94-4dc3-9ec5-0a0188e30b63 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:55.856461 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-dd3ae231-ba94-4dc3-9ec5-0a0188e30b63 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:55.857005 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-dd3ae231-ba94-4dc3-9ec5-0a0188e30b63 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:55.858329 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-dd3ae231-ba94-4dc3-9ec5-0a0188e30b63 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:55.859122 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-dd3ae231-ba94-4dc3-9ec5-0a0188e30b63 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:55.859685 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-dd3ae231-ba94-4dc3-9ec5-0a0188e30b63 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:55.864933 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell1:SELECT=100 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:55.993923 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-dd3ae231-ba94-4dc3-9ec5-0a0188e30b63 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:56.004585 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-dd3ae231-ba94-4dc3-9ec5-0a0188e30b63 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911" status: 200 len: 1365 microversion: 2.1 time: 0.165227 Sep 03 03:49:56.005180 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 76/164] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:55 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:56.279278 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-565a3a80-cb95-456a-b9ff-ec025d419649 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:56.279875 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-565a3a80-cb95-456a-b9ff-ec025d419649 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:56.286201 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-565a3a80-cb95-456a-b9ff-ec025d419649 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:56.286685 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-565a3a80-cb95-456a-b9ff-ec025d419649 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:56.287156 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-565a3a80-cb95-456a-b9ff-ec025d419649 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:56.287842 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-565a3a80-cb95-456a-b9ff-ec025d419649 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:56.288314 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-565a3a80-cb95-456a-b9ff-ec025d419649 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:56.288729 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-565a3a80-cb95-456a-b9ff-ec025d419649 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:56.365701 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-e2e7c209-321e-4d41-b26c-b45aadcc7d5e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:56.366287 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-e2e7c209-321e-4d41-b26c-b45aadcc7d5e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:56.372458 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e2e7c209-321e-4d41-b26c-b45aadcc7d5e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:56.372934 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e2e7c209-321e-4d41-b26c-b45aadcc7d5e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:56.373360 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e2e7c209-321e-4d41-b26c-b45aadcc7d5e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:56.374046 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e2e7c209-321e-4d41-b26c-b45aadcc7d5e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:56.374487 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e2e7c209-321e-4d41-b26c-b45aadcc7d5e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:56.374919 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e2e7c209-321e-4d41-b26c-b45aadcc7d5e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:56.433195 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-565a3a80-cb95-456a-b9ff-ec025d419649 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:56.441808 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-565a3a80-cb95-456a-b9ff-ec025d419649 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:56.443295 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-565a3a80-cb95-456a-b9ff-ec025d419649 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:56.444372 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-565a3a80-cb95-456a-b9ff-ec025d419649 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1407 microversion: 2.20 time: 0.168965 Sep 03 03:49:56.444905 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 89/165] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:49:56 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:49:56.449549 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-e8f66d29-2e93-476b-ad98-2e86aa9765e1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:56.450109 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-e8f66d29-2e93-476b-ad98-2e86aa9765e1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:56.456565 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e8f66d29-2e93-476b-ad98-2e86aa9765e1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:56.457090 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e8f66d29-2e93-476b-ad98-2e86aa9765e1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:56.457542 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e8f66d29-2e93-476b-ad98-2e86aa9765e1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:56.458201 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e8f66d29-2e93-476b-ad98-2e86aa9765e1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:56.458856 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e8f66d29-2e93-476b-ad98-2e86aa9765e1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:56.459473 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e8f66d29-2e93-476b-ad98-2e86aa9765e1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:56.504249 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-e2e7c209-321e-4d41-b26c-b45aadcc7d5e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:56.512073 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-e2e7c209-321e-4d41-b26c-b45aadcc7d5e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1321 microversion: 2.1 time: 0.150284 Sep 03 03:49:56.512643 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 77/166] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:56 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:49:56.586287 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-e8f66d29-2e93-476b-ad98-2e86aa9765e1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:56.594504 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-e8f66d29-2e93-476b-ad98-2e86aa9765e1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1364 microversion: 2.1 time: 0.148630 Sep 03 03:49:56.595343 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 90/167] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:56 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:56.762929 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-f66e3400-7bf5-4a6c-b7c0-c2cca93aae61 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:56.763579 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-f66e3400-7bf5-4a6c-b7c0-c2cca93aae61 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:56.766476 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=98 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:56.770885 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f66e3400-7bf5-4a6c-b7c0-c2cca93aae61 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:56.771354 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f66e3400-7bf5-4a6c-b7c0-c2cca93aae61 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:56.771784 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f66e3400-7bf5-4a6c-b7c0-c2cca93aae61 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:56.772468 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f66e3400-7bf5-4a6c-b7c0-c2cca93aae61 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:56.772933 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f66e3400-7bf5-4a6c-b7c0-c2cca93aae61 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:56.773333 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f66e3400-7bf5-4a6c-b7c0-c2cca93aae61 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:56.921986 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-f66e3400-7bf5-4a6c-b7c0-c2cca93aae61 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a959dec6c0c944aea231b65612892705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968cc9376f884f67b20b91547211fffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:56.944606 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-f66e3400-7bf5-4a6c-b7c0-c2cca93aae61 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 200 len: 1314 microversion: 2.1 time: 0.185571 Sep 03 03:49:56.945193 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 78/168] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:56 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:57.027507 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-257a0f6e-0b40-4163-92b5-b8609bfc3324 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:57.028083 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-257a0f6e-0b40-4163-92b5-b8609bfc3324 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:57.034347 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-257a0f6e-0b40-4163-92b5-b8609bfc3324 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:57.034823 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-257a0f6e-0b40-4163-92b5-b8609bfc3324 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:57.035258 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-257a0f6e-0b40-4163-92b5-b8609bfc3324 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:57.035954 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-257a0f6e-0b40-4163-92b5-b8609bfc3324 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:57.036365 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-257a0f6e-0b40-4163-92b5-b8609bfc3324 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:57.036944 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-257a0f6e-0b40-4163-92b5-b8609bfc3324 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:57.157274 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-7f187d23-974c-44fe-b44c-ba30f1124fd3 req-1cb2832f-d065-4a67-85cf-b245382b40f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "828bd786-6e99-4ccd-a4aa-9198ef8c8731", "name": "network-vif-plugged", "status": "completed", "tag": "c131716e-c4cf-4300-99d4-32cea2b1becb"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:49:57.167501 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-7f187d23-974c-44fe-b44c-ba30f1124fd3 req-1cb2832f-d065-4a67-85cf-b245382b40f0 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:57.167996 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-7f187d23-974c-44fe-b44c-ba30f1124fd3 req-1cb2832f-d065-4a67-85cf-b245382b40f0 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:57.168549 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-7f187d23-974c-44fe-b44c-ba30f1124fd3 req-1cb2832f-d065-4a67-85cf-b245382b40f0 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:57.185212 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-7f187d23-974c-44fe-b44c-ba30f1124fd3 req-1cb2832f-d065-4a67-85cf-b245382b40f0 service nova] Creating event network-vif-plugged:c131716e-c4cf-4300-99d4-32cea2b1becb for instance 828bd786-6e99-4ccd-a4aa-9198ef8c8731 on hv-cinder-79966 Sep 03 03:49:57.192899 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-7f187d23-974c-44fe-b44c-ba30f1124fd3 req-1cb2832f-d065-4a67-85cf-b245382b40f0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039339 Sep 03 03:49:57.194449 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 79/169] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 03:49:57.218651 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-257a0f6e-0b40-4163-92b5-b8609bfc3324 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:57.230444 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-257a0f6e-0b40-4163-92b5-b8609bfc3324 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911" status: 200 len: 1365 microversion: 2.1 time: 0.205456 Sep 03 03:49:57.231254 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 91/170] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:57 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 => generated 1365 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:57.470264 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-aa2bb4d9-0dfe-4a37-a5ea-602b1c3f38c5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:57.471195 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-aa2bb4d9-0dfe-4a37-a5ea-602b1c3f38c5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:57.477757 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-aa2bb4d9-0dfe-4a37-a5ea-602b1c3f38c5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:57.478196 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-aa2bb4d9-0dfe-4a37-a5ea-602b1c3f38c5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:57.478731 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-aa2bb4d9-0dfe-4a37-a5ea-602b1c3f38c5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:57.479443 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-aa2bb4d9-0dfe-4a37-a5ea-602b1c3f38c5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:57.479906 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-aa2bb4d9-0dfe-4a37-a5ea-602b1c3f38c5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:57.480345 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-aa2bb4d9-0dfe-4a37-a5ea-602b1c3f38c5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:57.534449 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-64d75c17-7d7f-4d46-8a7a-a9dd56ae2307 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:57.535211 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-64d75c17-7d7f-4d46-8a7a-a9dd56ae2307 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:57.541939 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-64d75c17-7d7f-4d46-8a7a-a9dd56ae2307 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:57.542496 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-64d75c17-7d7f-4d46-8a7a-a9dd56ae2307 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:57.542954 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-64d75c17-7d7f-4d46-8a7a-a9dd56ae2307 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:57.543677 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-64d75c17-7d7f-4d46-8a7a-a9dd56ae2307 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:57.544117 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-64d75c17-7d7f-4d46-8a7a-a9dd56ae2307 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:57.544527 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-64d75c17-7d7f-4d46-8a7a-a9dd56ae2307 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:57.620305 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-aa2bb4d9-0dfe-4a37-a5ea-602b1c3f38c5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:57.632778 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-aa2bb4d9-0dfe-4a37-a5ea-602b1c3f38c5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:57.634341 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-aa2bb4d9-0dfe-4a37-a5ea-602b1c3f38c5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:57.635901 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-aa2bb4d9-0dfe-4a37-a5ea-602b1c3f38c5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1407 microversion: 2.20 time: 0.170117 Sep 03 03:49:57.636439 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 80/171] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:49:57 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:49:57.640738 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-f19d0072-f08c-41c9-8509-9c650d0e29c6 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:57.641320 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-f19d0072-f08c-41c9-8509-9c650d0e29c6 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:57.647477 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f19d0072-f08c-41c9-8509-9c650d0e29c6 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:57.647977 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f19d0072-f08c-41c9-8509-9c650d0e29c6 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:57.648358 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f19d0072-f08c-41c9-8509-9c650d0e29c6 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:57.649033 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f19d0072-f08c-41c9-8509-9c650d0e29c6 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:57.649468 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f19d0072-f08c-41c9-8509-9c650d0e29c6 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:57.649876 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f19d0072-f08c-41c9-8509-9c650d0e29c6 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:57.708564 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-64d75c17-7d7f-4d46-8a7a-a9dd56ae2307 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:57.717821 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-64d75c17-7d7f-4d46-8a7a-a9dd56ae2307 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1321 microversion: 2.1 time: 0.187398 Sep 03 03:49:57.718695 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 92/172] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:57 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:57.792735 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-f19d0072-f08c-41c9-8509-9c650d0e29c6 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:57.800784 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-f19d0072-f08c-41c9-8509-9c650d0e29c6 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1364 microversion: 2.1 time: 0.163246 Sep 03 03:49:57.801304 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 81/173] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:57 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:57.967585 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-e81eade0-0acd-4f46-8b84-35430ad9eccc tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:57.968179 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-e81eade0-0acd-4f46-8b84-35430ad9eccc tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:57.971178 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_api:SELECT=100 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:57.974994 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e81eade0-0acd-4f46-8b84-35430ad9eccc tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:57.975445 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e81eade0-0acd-4f46-8b84-35430ad9eccc tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:57.975868 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e81eade0-0acd-4f46-8b84-35430ad9eccc tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:57.976537 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e81eade0-0acd-4f46-8b84-35430ad9eccc tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:57.976973 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e81eade0-0acd-4f46-8b84-35430ad9eccc tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:57.977380 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e81eade0-0acd-4f46-8b84-35430ad9eccc tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:58.113565 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-e81eade0-0acd-4f46-8b84-35430ad9eccc tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a959dec6c0c944aea231b65612892705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968cc9376f884f67b20b91547211fffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:58.123588 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-e81eade0-0acd-4f46-8b84-35430ad9eccc tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 200 len: 1314 microversion: 2.1 time: 0.159654 Sep 03 03:49:58.124428 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 93/174] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:57 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:58.254070 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-75904060-f7d8-43d3-91df-308b861aba37 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:58.254651 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-75904060-f7d8-43d3-91df-308b861aba37 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:58.261006 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-75904060-f7d8-43d3-91df-308b861aba37 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:58.261496 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-75904060-f7d8-43d3-91df-308b861aba37 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:58.261887 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-75904060-f7d8-43d3-91df-308b861aba37 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:58.262563 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-75904060-f7d8-43d3-91df-308b861aba37 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:58.263030 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-75904060-f7d8-43d3-91df-308b861aba37 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:58.263435 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-75904060-f7d8-43d3-91df-308b861aba37 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:58.407235 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-75904060-f7d8-43d3-91df-308b861aba37 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:58.419392 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-75904060-f7d8-43d3-91df-308b861aba37 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911" status: 200 len: 1365 microversion: 2.1 time: 0.169194 Sep 03 03:49:58.419979 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 82/175] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:58 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:58.665001 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-0d8943dd-142b-4179-8f49-61e2673c3e02 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:58.665667 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-0d8943dd-142b-4179-8f49-61e2673c3e02 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:58.671704 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0d8943dd-142b-4179-8f49-61e2673c3e02 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:58.672188 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0d8943dd-142b-4179-8f49-61e2673c3e02 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:58.672609 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0d8943dd-142b-4179-8f49-61e2673c3e02 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:58.673280 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0d8943dd-142b-4179-8f49-61e2673c3e02 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:58.673720 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0d8943dd-142b-4179-8f49-61e2673c3e02 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:58.674133 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0d8943dd-142b-4179-8f49-61e2673c3e02 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:58.741351 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-f1f875be-3d71-40ab-b765-3119d780a0ef tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:58.742022 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-f1f875be-3d71-40ab-b765-3119d780a0ef tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:58.749357 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f1f875be-3d71-40ab-b765-3119d780a0ef tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:58.751073 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f1f875be-3d71-40ab-b765-3119d780a0ef tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:58.751761 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f1f875be-3d71-40ab-b765-3119d780a0ef tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:58.767506 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f1f875be-3d71-40ab-b765-3119d780a0ef tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:58.767887 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f1f875be-3d71-40ab-b765-3119d780a0ef tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:58.768167 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f1f875be-3d71-40ab-b765-3119d780a0ef tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:58.813540 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-0d8943dd-142b-4179-8f49-61e2673c3e02 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:58.817000 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell1:SELECT=100 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:58.824416 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-0d8943dd-142b-4179-8f49-61e2673c3e02 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:58.825921 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-0d8943dd-142b-4179-8f49-61e2673c3e02 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:58.827139 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-0d8943dd-142b-4179-8f49-61e2673c3e02 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1407 microversion: 2.20 time: 0.166045 Sep 03 03:49:58.827698 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 94/176] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:49:58 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:49:58.832277 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-8c4ba0d5-0952-4077-893a-32f16d180521 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:58.832808 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-8c4ba0d5-0952-4077-893a-32f16d180521 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:58.838523 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8c4ba0d5-0952-4077-893a-32f16d180521 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:58.839196 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8c4ba0d5-0952-4077-893a-32f16d180521 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:58.839792 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8c4ba0d5-0952-4077-893a-32f16d180521 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:58.840622 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8c4ba0d5-0952-4077-893a-32f16d180521 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:58.841211 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8c4ba0d5-0952-4077-893a-32f16d180521 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:58.841769 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8c4ba0d5-0952-4077-893a-32f16d180521 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:58.904708 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-f1f875be-3d71-40ab-b765-3119d780a0ef tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:58.912772 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-f1f875be-3d71-40ab-b765-3119d780a0ef tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1321 microversion: 2.1 time: 0.175297 Sep 03 03:49:58.913316 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 83/177] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:58 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:58.978033 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-8c4ba0d5-0952-4077-893a-32f16d180521 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:58.990152 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-8c4ba0d5-0952-4077-893a-32f16d180521 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1364 microversion: 2.1 time: 0.161230 Sep 03 03:49:58.990993 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 95/178] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:58 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:59.147841 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-117e21b3-c64d-4a3c-a526-93ec5cb620b1 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:59.148372 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-117e21b3-c64d-4a3c-a526-93ec5cb620b1 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:59.154548 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-117e21b3-c64d-4a3c-a526-93ec5cb620b1 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:59.155226 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-117e21b3-c64d-4a3c-a526-93ec5cb620b1 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:59.155661 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-117e21b3-c64d-4a3c-a526-93ec5cb620b1 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:59.156376 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-117e21b3-c64d-4a3c-a526-93ec5cb620b1 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:59.156858 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-117e21b3-c64d-4a3c-a526-93ec5cb620b1 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:59.157275 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-117e21b3-c64d-4a3c-a526-93ec5cb620b1 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:59.212102 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-8ccac1a6-c81b-4ae1-808e-9d2bb6d84876 req-6910aab6-d05b-428b-b7ba-c156adee568d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5154156-831e-45fa-b20b-3c6bd4f1f383", "name": "network-vif-plugged", "status": "completed", "tag": "45d48f27-6986-4559-b518-e64ca4982470"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:49:59.223138 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-8ccac1a6-c81b-4ae1-808e-9d2bb6d84876 req-6910aab6-d05b-428b-b7ba-c156adee568d service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:59.223610 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-8ccac1a6-c81b-4ae1-808e-9d2bb6d84876 req-6910aab6-d05b-428b-b7ba-c156adee568d service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:59.224035 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-8ccac1a6-c81b-4ae1-808e-9d2bb6d84876 req-6910aab6-d05b-428b-b7ba-c156adee568d service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:59.236372 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-8ccac1a6-c81b-4ae1-808e-9d2bb6d84876 req-6910aab6-d05b-428b-b7ba-c156adee568d service nova] Creating event network-vif-plugged:45d48f27-6986-4559-b518-e64ca4982470 for instance e5154156-831e-45fa-b20b-3c6bd4f1f383 on hv-cinder-79966 Sep 03 03:49:59.241654 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-8ccac1a6-c81b-4ae1-808e-9d2bb6d84876 req-6910aab6-d05b-428b-b7ba-c156adee568d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033244 Sep 03 03:49:59.242423 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 96/179] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:49:59.283999 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-117e21b3-c64d-4a3c-a526-93ec5cb620b1 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a959dec6c0c944aea231b65612892705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968cc9376f884f67b20b91547211fffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:59.291687 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-117e21b3-c64d-4a3c-a526-93ec5cb620b1 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 200 len: 1314 microversion: 2.1 time: 0.147857 Sep 03 03:49:59.292250 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 84/180] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:59 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:59.445856 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-359be2d7-3d29-49aa-b9cf-6f9d0d204598 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:59.446547 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-359be2d7-3d29-49aa-b9cf-6f9d0d204598 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:59.452932 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-359be2d7-3d29-49aa-b9cf-6f9d0d204598 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:59.453408 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-359be2d7-3d29-49aa-b9cf-6f9d0d204598 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:59.453838 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-359be2d7-3d29-49aa-b9cf-6f9d0d204598 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:59.454548 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-359be2d7-3d29-49aa-b9cf-6f9d0d204598 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:59.455031 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-359be2d7-3d29-49aa-b9cf-6f9d0d204598 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:59.455448 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-359be2d7-3d29-49aa-b9cf-6f9d0d204598 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:59.597728 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-359be2d7-3d29-49aa-b9cf-6f9d0d204598 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:49:59.605740 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-359be2d7-3d29-49aa-b9cf-6f9d0d204598 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911" status: 200 len: 1365 microversion: 2.1 time: 0.164028 Sep 03 03:49:59.606305 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 97/181] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:59 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:49:59.855083 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-cc7501d4-f2a9-4f45-a4c8-4a372840cce4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:59.855719 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-cc7501d4-f2a9-4f45-a4c8-4a372840cce4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:59.865271 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cc7501d4-f2a9-4f45-a4c8-4a372840cce4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:59.865951 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cc7501d4-f2a9-4f45-a4c8-4a372840cce4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:59.866567 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cc7501d4-f2a9-4f45-a4c8-4a372840cce4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:59.867518 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cc7501d4-f2a9-4f45-a4c8-4a372840cce4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:59.868158 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cc7501d4-f2a9-4f45-a4c8-4a372840cce4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:59.868735 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cc7501d4-f2a9-4f45-a4c8-4a372840cce4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:59.935400 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-6dc217a8-9151-47e8-805c-3fcabbecfef1 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:49:59.936191 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-6dc217a8-9151-47e8-805c-3fcabbecfef1 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:49:59.942340 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6dc217a8-9151-47e8-805c-3fcabbecfef1 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:59.942928 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6dc217a8-9151-47e8-805c-3fcabbecfef1 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:59.943415 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6dc217a8-9151-47e8-805c-3fcabbecfef1 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:59.944167 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6dc217a8-9151-47e8-805c-3fcabbecfef1 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:49:59.944686 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6dc217a8-9151-47e8-805c-3fcabbecfef1 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:49:59.945160 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6dc217a8-9151-47e8-805c-3fcabbecfef1 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:49:59.997821 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-cc7501d4-f2a9-4f45-a4c8-4a372840cce4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:00.006154 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-cc7501d4-f2a9-4f45-a4c8-4a372840cce4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:00.007654 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-cc7501d4-f2a9-4f45-a4c8-4a372840cce4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:00.008837 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-cc7501d4-f2a9-4f45-a4c8-4a372840cce4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1407 microversion: 2.20 time: 0.159848 Sep 03 03:50:00.009400 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 85/182] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:49:59 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:50:00.014030 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-ab6f3310-37e9-4dc6-a6d4-61a712dc2ec1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:00.014655 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-ab6f3310-37e9-4dc6-a6d4-61a712dc2ec1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:00.020809 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ab6f3310-37e9-4dc6-a6d4-61a712dc2ec1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:00.021940 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ab6f3310-37e9-4dc6-a6d4-61a712dc2ec1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:00.021940 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ab6f3310-37e9-4dc6-a6d4-61a712dc2ec1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:00.022795 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ab6f3310-37e9-4dc6-a6d4-61a712dc2ec1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:00.023305 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ab6f3310-37e9-4dc6-a6d4-61a712dc2ec1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:00.023817 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ab6f3310-37e9-4dc6-a6d4-61a712dc2ec1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:00.076203 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-6dc217a8-9151-47e8-805c-3fcabbecfef1 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:00.085664 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-6dc217a8-9151-47e8-805c-3fcabbecfef1 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1321 microversion: 2.1 time: 0.154131 Sep 03 03:50:00.086399 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 98/183] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:49:59 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:00.173905 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-ab6f3310-37e9-4dc6-a6d4-61a712dc2ec1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:00.182633 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-ab6f3310-37e9-4dc6-a6d4-61a712dc2ec1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1364 microversion: 2.1 time: 0.172067 Sep 03 03:50:00.183579 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 86/184] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:00 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:00.317702 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-92273056-5c10-4592-b09f-c11e25eb0cab tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:00.318554 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-92273056-5c10-4592-b09f-c11e25eb0cab tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:00.328514 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-92273056-5c10-4592-b09f-c11e25eb0cab tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:00.329296 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-92273056-5c10-4592-b09f-c11e25eb0cab tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:00.330003 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-92273056-5c10-4592-b09f-c11e25eb0cab tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:00.331303 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-92273056-5c10-4592-b09f-c11e25eb0cab tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:00.331753 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-92273056-5c10-4592-b09f-c11e25eb0cab tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:00.332178 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-92273056-5c10-4592-b09f-c11e25eb0cab tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:00.481660 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-92273056-5c10-4592-b09f-c11e25eb0cab tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a959dec6c0c944aea231b65612892705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968cc9376f884f67b20b91547211fffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:00.490621 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-92273056-5c10-4592-b09f-c11e25eb0cab tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 200 len: 1314 microversion: 2.1 time: 0.179267 Sep 03 03:50:00.507424 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 99/185] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:00 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:00.629364 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-6a7bb563-6f87-4d58-9991-7f309390944e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:00.630222 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-6a7bb563-6f87-4d58-9991-7f309390944e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:00.636413 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6a7bb563-6f87-4d58-9991-7f309390944e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:00.637112 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6a7bb563-6f87-4d58-9991-7f309390944e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:00.637523 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6a7bb563-6f87-4d58-9991-7f309390944e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:00.638437 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6a7bb563-6f87-4d58-9991-7f309390944e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:00.639075 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6a7bb563-6f87-4d58-9991-7f309390944e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:00.639481 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6a7bb563-6f87-4d58-9991-7f309390944e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:00.846650 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-6a7bb563-6f87-4d58-9991-7f309390944e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:00.854751 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-6a7bb563-6f87-4d58-9991-7f309390944e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911" status: 200 len: 1365 microversion: 2.1 time: 0.229489 Sep 03 03:50:00.857763 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 87/186] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:00 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:01.036068 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-81ed9d92-ec11-4994-9780-dd60985f62bf tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:01.036811 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-81ed9d92-ec11-4994-9780-dd60985f62bf tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:01.043059 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-81ed9d92-ec11-4994-9780-dd60985f62bf tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:01.043549 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-81ed9d92-ec11-4994-9780-dd60985f62bf tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:01.043971 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-81ed9d92-ec11-4994-9780-dd60985f62bf tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:01.044656 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-81ed9d92-ec11-4994-9780-dd60985f62bf tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:01.045101 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-81ed9d92-ec11-4994-9780-dd60985f62bf tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:01.045514 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-81ed9d92-ec11-4994-9780-dd60985f62bf tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:01.110642 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-047d74a2-f24e-4660-a25b-f00f0c18a600 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:01.113520 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-047d74a2-f24e-4660-a25b-f00f0c18a600 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:01.121622 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-047d74a2-f24e-4660-a25b-f00f0c18a600 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:01.124204 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-047d74a2-f24e-4660-a25b-f00f0c18a600 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:01.125123 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-047d74a2-f24e-4660-a25b-f00f0c18a600 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:01.127015 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-047d74a2-f24e-4660-a25b-f00f0c18a600 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:01.127497 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-047d74a2-f24e-4660-a25b-f00f0c18a600 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:01.128049 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-047d74a2-f24e-4660-a25b-f00f0c18a600 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:01.370280 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-81ed9d92-ec11-4994-9780-dd60985f62bf tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:01.384805 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-81ed9d92-ec11-4994-9780-dd60985f62bf tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:01.388335 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-81ed9d92-ec11-4994-9780-dd60985f62bf tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:01.391142 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-81ed9d92-ec11-4994-9780-dd60985f62bf tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1407 microversion: 2.20 time: 0.359276 Sep 03 03:50:01.409523 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 100/187] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:50:01 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1407 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:50:01.425138 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-aee6103b-c158-4228-91d8-3a6039a3c80d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:01.425714 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-aee6103b-c158-4228-91d8-3a6039a3c80d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:01.433601 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-aee6103b-c158-4228-91d8-3a6039a3c80d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:01.434357 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-aee6103b-c158-4228-91d8-3a6039a3c80d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:01.434772 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-aee6103b-c158-4228-91d8-3a6039a3c80d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:01.435657 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-aee6103b-c158-4228-91d8-3a6039a3c80d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:01.436258 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-aee6103b-c158-4228-91d8-3a6039a3c80d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:01.436675 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-aee6103b-c158-4228-91d8-3a6039a3c80d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:01.477927 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-047d74a2-f24e-4660-a25b-f00f0c18a600 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:01.488956 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-047d74a2-f24e-4660-a25b-f00f0c18a600 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1515 microversion: 2.1 time: 0.383248 Sep 03 03:50:01.503435 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 88/188] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:01 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1515 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:01.522103 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-a3bf5dc8-f5a8-4cd3-a40f-188594df43cd tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:50:01.525443 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-a3bf5dc8-f5a8-4cd3-a40f-188594df43cd tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:01.533392 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a3bf5dc8-f5a8-4cd3-a40f-188594df43cd tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:01.534108 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a3bf5dc8-f5a8-4cd3-a40f-188594df43cd tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:01.534688 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a3bf5dc8-f5a8-4cd3-a40f-188594df43cd tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:01.535580 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a3bf5dc8-f5a8-4cd3-a40f-188594df43cd tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:01.536172 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a3bf5dc8-f5a8-4cd3-a40f-188594df43cd tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:01.536723 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a3bf5dc8-f5a8-4cd3-a40f-188594df43cd tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:01.609449 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.objects.instance [None req-a3bf5dc8-f5a8-4cd3-a40f-188594df43cd tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lazy-loading 'flavor' on Instance uuid 5ab059eb-4353-4c86-91ae-089e1c35f387 {{(pid=132077) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 03:50:01.675385 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-aee6103b-c158-4228-91d8-3a6039a3c80d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:01.683045 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-aee6103b-c158-4228-91d8-3a6039a3c80d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1364 microversion: 2.1 time: 0.266485 Sep 03 03:50:01.683810 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 101/189] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:01 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1364 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:01.688489 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-6e5d3550-388e-4aee-bf73-9ae957be80af tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:01.689143 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-6e5d3550-388e-4aee-bf73-9ae957be80af tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:01.694709 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6e5d3550-388e-4aee-bf73-9ae957be80af tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:01.695466 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6e5d3550-388e-4aee-bf73-9ae957be80af tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:01.695969 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6e5d3550-388e-4aee-bf73-9ae957be80af tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:01.696699 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6e5d3550-388e-4aee-bf73-9ae957be80af tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:01.697201 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6e5d3550-388e-4aee-bf73-9ae957be80af tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:01.697680 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6e5d3550-388e-4aee-bf73-9ae957be80af tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:01.737942 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-a3bf5dc8-f5a8-4cd3-a40f-188594df43cd tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "POST /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387/action" status: 200 len: 32 microversion: 2.1 time: 0.229004 Sep 03 03:50:01.742880 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 89/190] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Sep 3 03:50:01 2022] POST /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387/action => generated 32 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 03:50:01.748485 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-f4869ec1-312a-4931-a68d-82e0786505d3 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:01.749163 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-f4869ec1-312a-4931-a68d-82e0786505d3 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:01.755498 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f4869ec1-312a-4931-a68d-82e0786505d3 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:01.755969 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f4869ec1-312a-4931-a68d-82e0786505d3 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:01.756440 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f4869ec1-312a-4931-a68d-82e0786505d3 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:01.757116 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f4869ec1-312a-4931-a68d-82e0786505d3 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:01.757552 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f4869ec1-312a-4931-a68d-82e0786505d3 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:01.757958 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f4869ec1-312a-4931-a68d-82e0786505d3 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:01.833122 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-6e5d3550-388e-4aee-bf73-9ae957be80af tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a959dec6c0c944aea231b65612892705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968cc9376f884f67b20b91547211fffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:01.841084 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-6e5d3550-388e-4aee-bf73-9ae957be80af tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 200 len: 1314 microversion: 2.1 time: 0.156235 Sep 03 03:50:01.841651 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 102/191] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:01 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:01.880353 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-234bd202-ecb2-459d-808e-97d03383c175 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:01.881036 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-234bd202-ecb2-459d-808e-97d03383c175 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:01.887285 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-234bd202-ecb2-459d-808e-97d03383c175 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:01.887894 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-234bd202-ecb2-459d-808e-97d03383c175 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:01.888496 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-234bd202-ecb2-459d-808e-97d03383c175 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:01.889240 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-234bd202-ecb2-459d-808e-97d03383c175 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:01.889623 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-234bd202-ecb2-459d-808e-97d03383c175 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:01.890036 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-234bd202-ecb2-459d-808e-97d03383c175 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:01.897133 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-f4869ec1-312a-4931-a68d-82e0786505d3 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:01.905826 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-f4869ec1-312a-4931-a68d-82e0786505d3 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1521 microversion: 2.1 time: 0.161520 Sep 03 03:50:01.906399 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 90/192] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:01 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:02.022192 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-234bd202-ecb2-459d-808e-97d03383c175 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:02.030586 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-234bd202-ecb2-459d-808e-97d03383c175 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911" status: 200 len: 1555 microversion: 2.1 time: 0.154268 Sep 03 03:50:02.031165 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 103/193] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:01 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:02.054847 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-9dee9689-aeb5-4148-8eaf-e2a0fb3958c7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:02.055341 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-9dee9689-aeb5-4148-8eaf-e2a0fb3958c7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:02.061731 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9dee9689-aeb5-4148-8eaf-e2a0fb3958c7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:02.062234 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9dee9689-aeb5-4148-8eaf-e2a0fb3958c7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:02.062653 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9dee9689-aeb5-4148-8eaf-e2a0fb3958c7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:02.063421 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9dee9689-aeb5-4148-8eaf-e2a0fb3958c7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:02.063871 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9dee9689-aeb5-4148-8eaf-e2a0fb3958c7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:02.064279 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9dee9689-aeb5-4148-8eaf-e2a0fb3958c7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:02.082625 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:02.146657 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-9dee9689-aeb5-4148-8eaf-e2a0fb3958c7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095734 Sep 03 03:50:02.147316 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 91/194] 10.222.0.25 () {58 vars in 1275 bytes} [Sat Sep 3 03:50:02 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:50:02.231284 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-447a5c83-237c-413a-9048-60fe4f3a9ac9 req-932ae0f0-333c-477d-b5e0-423fb3a2b5f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d61f1c-d865-4d0d-89a9-1f91f0f8bf78", "name": "network-vif-plugged", "status": "completed", "tag": "dc502e70-8b66-4849-929e-0879ed88e591"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:50:02.259700 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-447a5c83-237c-413a-9048-60fe4f3a9ac9 req-932ae0f0-333c-477d-b5e0-423fb3a2b5f6 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:02.260333 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-447a5c83-237c-413a-9048-60fe4f3a9ac9 req-932ae0f0-333c-477d-b5e0-423fb3a2b5f6 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:02.260764 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-447a5c83-237c-413a-9048-60fe4f3a9ac9 req-932ae0f0-333c-477d-b5e0-423fb3a2b5f6 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:02.284758 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-447a5c83-237c-413a-9048-60fe4f3a9ac9 req-932ae0f0-333c-477d-b5e0-423fb3a2b5f6 service nova] Creating event network-vif-plugged:dc502e70-8b66-4849-929e-0879ed88e591 for instance 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 on hv-cinder-79966 Sep 03 03:50:02.296171 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-447a5c83-237c-413a-9048-60fe4f3a9ac9 req-932ae0f0-333c-477d-b5e0-423fb3a2b5f6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070487 Sep 03 03:50:02.297399 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 104/195] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:50:02.419135 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-7d0ecb4f-04cd-4d41-a608-c2b8327f85f7 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:02.419967 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-7d0ecb4f-04cd-4d41-a608-c2b8327f85f7 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:02.432680 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7d0ecb4f-04cd-4d41-a608-c2b8327f85f7 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:02.433179 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7d0ecb4f-04cd-4d41-a608-c2b8327f85f7 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:02.433605 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7d0ecb4f-04cd-4d41-a608-c2b8327f85f7 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:02.434299 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7d0ecb4f-04cd-4d41-a608-c2b8327f85f7 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:02.434736 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7d0ecb4f-04cd-4d41-a608-c2b8327f85f7 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:02.439705 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7d0ecb4f-04cd-4d41-a608-c2b8327f85f7 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:02.665598 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-7d0ecb4f-04cd-4d41-a608-c2b8327f85f7 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:02.681094 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-7d0ecb4f-04cd-4d41-a608-c2b8327f85f7 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:02.683705 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-7d0ecb4f-04cd-4d41-a608-c2b8327f85f7 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:02.685518 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-7d0ecb4f-04cd-4d41-a608-c2b8327f85f7 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1407 microversion: 2.20 time: 0.271958 Sep 03 03:50:02.686503 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 92/196] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:50:02 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1407 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:50:02.715147 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-562ef82e-f3c1-4306-a043-e02f2bc61244 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:02.715888 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-562ef82e-f3c1-4306-a043-e02f2bc61244 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:02.723351 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-562ef82e-f3c1-4306-a043-e02f2bc61244 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:02.724080 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-562ef82e-f3c1-4306-a043-e02f2bc61244 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:02.724650 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-562ef82e-f3c1-4306-a043-e02f2bc61244 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:02.725543 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-562ef82e-f3c1-4306-a043-e02f2bc61244 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:02.726139 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-562ef82e-f3c1-4306-a043-e02f2bc61244 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:02.726719 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-562ef82e-f3c1-4306-a043-e02f2bc61244 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:02.865191 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-f9ee3dbc-8de2-4ae3-8980-efe51b97b63e tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:02.865799 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-f9ee3dbc-8de2-4ae3-8980-efe51b97b63e tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:02.872339 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f9ee3dbc-8de2-4ae3-8980-efe51b97b63e tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:02.872841 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f9ee3dbc-8de2-4ae3-8980-efe51b97b63e tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:02.873239 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f9ee3dbc-8de2-4ae3-8980-efe51b97b63e tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:02.873929 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f9ee3dbc-8de2-4ae3-8980-efe51b97b63e tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:02.874394 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f9ee3dbc-8de2-4ae3-8980-efe51b97b63e tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:02.874863 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f9ee3dbc-8de2-4ae3-8980-efe51b97b63e tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:03.015021 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-f9ee3dbc-8de2-4ae3-8980-efe51b97b63e tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a959dec6c0c944aea231b65612892705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968cc9376f884f67b20b91547211fffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:03.023121 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-f9ee3dbc-8de2-4ae3-8980-efe51b97b63e tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 200 len: 1314 microversion: 2.1 time: 0.162058 Sep 03 03:50:03.023706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 93/197] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:02 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:50:03.037868 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-eb8aae29-d58c-4f21-90fb-766e279042e6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:03.037868 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-eb8aae29-d58c-4f21-90fb-766e279042e6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:03.037868 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eb8aae29-d58c-4f21-90fb-766e279042e6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:03.037868 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eb8aae29-d58c-4f21-90fb-766e279042e6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:03.038233 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eb8aae29-d58c-4f21-90fb-766e279042e6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:03.038233 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eb8aae29-d58c-4f21-90fb-766e279042e6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:03.038233 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eb8aae29-d58c-4f21-90fb-766e279042e6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:03.038233 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eb8aae29-d58c-4f21-90fb-766e279042e6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:03.184162 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-eb8aae29-d58c-4f21-90fb-766e279042e6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:03.193259 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-eb8aae29-d58c-4f21-90fb-766e279042e6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1521 microversion: 2.1 time: 0.168513 Sep 03 03:50:03.200695 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 94/198] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:03 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:03.231995 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-562ef82e-f3c1-4306-a043-e02f2bc61244 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:03.242838 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-562ef82e-f3c1-4306-a043-e02f2bc61244 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1364 microversion: 2.1 time: 0.532547 Sep 03 03:50:03.244151 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 105/199] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:02 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1364 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:03.711656 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-eb0d066c-5ba2-46b4-ac8b-6bf71b25b2f9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:03.712438 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-eb0d066c-5ba2-46b4-ac8b-6bf71b25b2f9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:03.718638 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eb0d066c-5ba2-46b4-ac8b-6bf71b25b2f9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:03.719261 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eb0d066c-5ba2-46b4-ac8b-6bf71b25b2f9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:03.719770 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eb0d066c-5ba2-46b4-ac8b-6bf71b25b2f9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:03.720564 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eb0d066c-5ba2-46b4-ac8b-6bf71b25b2f9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:03.721109 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eb0d066c-5ba2-46b4-ac8b-6bf71b25b2f9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:03.721704 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eb0d066c-5ba2-46b4-ac8b-6bf71b25b2f9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:03.799377 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-fe109aaa-3072-4113-b55b-a8967c3c149c req-56f006c8-8a74-4900-be1f-1140ccababca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69fe618d-1192-4541-9d90-e5cee06be911", "tag": "1197b605-d728-4d04-90d2-9befd8120dd4"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:50:03.807846 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-fe109aaa-3072-4113-b55b-a8967c3c149c req-56f006c8-8a74-4900-be1f-1140ccababca service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:03.808308 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-fe109aaa-3072-4113-b55b-a8967c3c149c req-56f006c8-8a74-4900-be1f-1140ccababca service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:03.808724 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-fe109aaa-3072-4113-b55b-a8967c3c149c req-56f006c8-8a74-4900-be1f-1140ccababca service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:03.820908 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-fe109aaa-3072-4113-b55b-a8967c3c149c req-56f006c8-8a74-4900-be1f-1140ccababca service nova] Creating event network-changed:1197b605-d728-4d04-90d2-9befd8120dd4 for instance 69fe618d-1192-4541-9d90-e5cee06be911 on hv-cinder-79966 Sep 03 03:50:03.826699 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-fe109aaa-3072-4113-b55b-a8967c3c149c req-56f006c8-8a74-4900-be1f-1140ccababca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031625 Sep 03 03:50:03.827790 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 106/200] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 03:50:03.878112 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-eb0d066c-5ba2-46b4-ac8b-6bf71b25b2f9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:03.887250 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-eb0d066c-5ba2-46b4-ac8b-6bf71b25b2f9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:03.889759 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-eb0d066c-5ba2-46b4-ac8b-6bf71b25b2f9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:03.890884 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-eb0d066c-5ba2-46b4-ac8b-6bf71b25b2f9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1407 microversion: 2.20 time: 0.183168 Sep 03 03:50:03.891835 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 95/201] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:50:03 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:50:04.048662 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-41b37deb-06b9-439f-bccf-f12aacd71024 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:04.049382 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-41b37deb-06b9-439f-bccf-f12aacd71024 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:04.056538 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-41b37deb-06b9-439f-bccf-f12aacd71024 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:04.057166 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-41b37deb-06b9-439f-bccf-f12aacd71024 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:04.057727 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-41b37deb-06b9-439f-bccf-f12aacd71024 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:04.058600 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-41b37deb-06b9-439f-bccf-f12aacd71024 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:04.059208 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-41b37deb-06b9-439f-bccf-f12aacd71024 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:04.059775 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-41b37deb-06b9-439f-bccf-f12aacd71024 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:04.218075 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-1ac6b190-5a72-437b-b6f7-119254168620 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:04.219310 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-1ac6b190-5a72-437b-b6f7-119254168620 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:04.229240 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1ac6b190-5a72-437b-b6f7-119254168620 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:04.229753 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1ac6b190-5a72-437b-b6f7-119254168620 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:04.230201 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-41b37deb-06b9-439f-bccf-f12aacd71024 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a959dec6c0c944aea231b65612892705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968cc9376f884f67b20b91547211fffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:04.236663 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1ac6b190-5a72-437b-b6f7-119254168620 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:04.238573 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-41b37deb-06b9-439f-bccf-f12aacd71024 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 200 len: 1314 microversion: 2.1 time: 0.195116 Sep 03 03:50:04.240355 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1ac6b190-5a72-437b-b6f7-119254168620 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:04.240841 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1ac6b190-5a72-437b-b6f7-119254168620 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:04.241845 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1ac6b190-5a72-437b-b6f7-119254168620 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:04.257062 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 107/202] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:04 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:04.266960 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-10ffc950-4bc7-4aab-b52f-9aebff638518 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:04.267832 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-10ffc950-4bc7-4aab-b52f-9aebff638518 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:04.275409 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-10ffc950-4bc7-4aab-b52f-9aebff638518 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:04.276244 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-10ffc950-4bc7-4aab-b52f-9aebff638518 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:04.276875 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-10ffc950-4bc7-4aab-b52f-9aebff638518 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:04.277887 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-10ffc950-4bc7-4aab-b52f-9aebff638518 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:04.278533 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-10ffc950-4bc7-4aab-b52f-9aebff638518 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:04.279280 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-10ffc950-4bc7-4aab-b52f-9aebff638518 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:04.430346 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-1ac6b190-5a72-437b-b6f7-119254168620 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:04.448970 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-1ac6b190-5a72-437b-b6f7-119254168620 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1521 microversion: 2.1 time: 0.236281 Sep 03 03:50:04.449772 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 96/203] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:04 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:50:04.504393 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-10ffc950-4bc7-4aab-b52f-9aebff638518 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:04.515274 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-10ffc950-4bc7-4aab-b52f-9aebff638518 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1549 microversion: 2.1 time: 0.253248 Sep 03 03:50:04.516011 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 108/204] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:04 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1549 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:04.539114 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-3fbe2f10-adc3-4704-9531-b4d65bf4a89c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:04.539600 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-3fbe2f10-adc3-4704-9531-b4d65bf4a89c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:04.545448 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3fbe2f10-adc3-4704-9531-b4d65bf4a89c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:04.545920 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3fbe2f10-adc3-4704-9531-b4d65bf4a89c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:04.546340 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3fbe2f10-adc3-4704-9531-b4d65bf4a89c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:04.547043 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3fbe2f10-adc3-4704-9531-b4d65bf4a89c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:04.547479 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3fbe2f10-adc3-4704-9531-b4d65bf4a89c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:04.548055 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3fbe2f10-adc3-4704-9531-b4d65bf4a89c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:04.631066 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-3fbe2f10-adc3-4704-9531-b4d65bf4a89c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096715 Sep 03 03:50:04.631990 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 97/205] 10.222.0.25 () {58 vars in 1275 bytes} [Sat Sep 3 03:50:04 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:50:04.919951 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-6bc7bd36-3cf4-4321-ba92-ce496445064d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:04.921125 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-6bc7bd36-3cf4-4321-ba92-ce496445064d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:04.928112 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6bc7bd36-3cf4-4321-ba92-ce496445064d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:04.928844 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6bc7bd36-3cf4-4321-ba92-ce496445064d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:04.929507 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6bc7bd36-3cf4-4321-ba92-ce496445064d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:04.930623 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6bc7bd36-3cf4-4321-ba92-ce496445064d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:04.931605 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6bc7bd36-3cf4-4321-ba92-ce496445064d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:04.932237 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6bc7bd36-3cf4-4321-ba92-ce496445064d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:05.187450 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-6bc7bd36-3cf4-4321-ba92-ce496445064d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:05.195413 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-6bc7bd36-3cf4-4321-ba92-ce496445064d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:05.196857 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-6bc7bd36-3cf4-4321-ba92-ce496445064d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:05.203182 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-6bc7bd36-3cf4-4321-ba92-ce496445064d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1407 microversion: 2.20 time: 0.287599 Sep 03 03:50:05.219608 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 109/206] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:50:04 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1407 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 03:50:05.264751 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-05dd2432-846d-4d10-8ecc-269fb8ff06ac tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:05.266163 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-05dd2432-846d-4d10-8ecc-269fb8ff06ac tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:05.272851 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-05dd2432-846d-4d10-8ecc-269fb8ff06ac tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:05.273425 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-05dd2432-846d-4d10-8ecc-269fb8ff06ac tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:05.274126 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-05dd2432-846d-4d10-8ecc-269fb8ff06ac tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:05.274852 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-05dd2432-846d-4d10-8ecc-269fb8ff06ac tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:05.275522 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-05dd2432-846d-4d10-8ecc-269fb8ff06ac tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:05.276187 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-05dd2432-846d-4d10-8ecc-269fb8ff06ac tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:05.472394 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-ee59f44c-eb39-421e-a1cf-ab9ee095d2dc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:05.473005 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-ee59f44c-eb39-421e-a1cf-ab9ee095d2dc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:05.498347 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ee59f44c-eb39-421e-a1cf-ab9ee095d2dc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:05.498872 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ee59f44c-eb39-421e-a1cf-ab9ee095d2dc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:05.499311 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ee59f44c-eb39-421e-a1cf-ab9ee095d2dc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:05.500022 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ee59f44c-eb39-421e-a1cf-ab9ee095d2dc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:05.500468 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ee59f44c-eb39-421e-a1cf-ab9ee095d2dc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:05.500882 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ee59f44c-eb39-421e-a1cf-ab9ee095d2dc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:05.754267 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-05dd2432-846d-4d10-8ecc-269fb8ff06ac tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a959dec6c0c944aea231b65612892705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968cc9376f884f67b20b91547211fffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:05.771126 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-05dd2432-846d-4d10-8ecc-269fb8ff06ac tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 200 len: 1502 microversion: 2.1 time: 0.510573 Sep 03 03:50:05.772590 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 98/207] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:05 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 1502 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:06.028729 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-ee59f44c-eb39-421e-a1cf-ab9ee095d2dc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:06.040989 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-ee59f44c-eb39-421e-a1cf-ab9ee095d2dc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1521 microversion: 2.1 time: 0.569402 Sep 03 03:50:06.053189 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 110/208] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:05 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1521 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:50:06.248012 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-d8981ec7-99b8-49cc-a0fb-40a32e69c1ee tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:06.248673 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-d8981ec7-99b8-49cc-a0fb-40a32e69c1ee tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:06.266860 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d8981ec7-99b8-49cc-a0fb-40a32e69c1ee tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:06.267362 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d8981ec7-99b8-49cc-a0fb-40a32e69c1ee tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:06.267779 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d8981ec7-99b8-49cc-a0fb-40a32e69c1ee tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:06.268561 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d8981ec7-99b8-49cc-a0fb-40a32e69c1ee tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:06.269009 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d8981ec7-99b8-49cc-a0fb-40a32e69c1ee tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:06.269432 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d8981ec7-99b8-49cc-a0fb-40a32e69c1ee tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:06.580208 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-d8981ec7-99b8-49cc-a0fb-40a32e69c1ee tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:06.591970 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-d8981ec7-99b8-49cc-a0fb-40a32e69c1ee tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:06.595012 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-d8981ec7-99b8-49cc-a0fb-40a32e69c1ee tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:06.595012 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-d8981ec7-99b8-49cc-a0fb-40a32e69c1ee tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1407 microversion: 2.20 time: 0.353731 Sep 03 03:50:06.603964 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 99/209] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:50:06 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1407 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:50:06.938597 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-11aea4be-3aa4-4f3a-a7c4-e3e326f968dc req-7daa543a-e68b-4e67-a606-f55ba430e60f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "828bd786-6e99-4ccd-a4aa-9198ef8c8731", "tag": "c131716e-c4cf-4300-99d4-32cea2b1becb"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:50:06.951480 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-11aea4be-3aa4-4f3a-a7c4-e3e326f968dc req-7daa543a-e68b-4e67-a606-f55ba430e60f service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:06.951943 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-11aea4be-3aa4-4f3a-a7c4-e3e326f968dc req-7daa543a-e68b-4e67-a606-f55ba430e60f service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:06.952356 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-11aea4be-3aa4-4f3a-a7c4-e3e326f968dc req-7daa543a-e68b-4e67-a606-f55ba430e60f service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:06.972356 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-11aea4be-3aa4-4f3a-a7c4-e3e326f968dc req-7daa543a-e68b-4e67-a606-f55ba430e60f service nova] Creating event network-changed:c131716e-c4cf-4300-99d4-32cea2b1becb for instance 828bd786-6e99-4ccd-a4aa-9198ef8c8731 on hv-cinder-79966 Sep 03 03:50:06.990773 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-11aea4be-3aa4-4f3a-a7c4-e3e326f968dc req-7daa543a-e68b-4e67-a606-f55ba430e60f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055631 Sep 03 03:50:06.991773 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 111/210] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:50:07.073174 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-c75104c6-d8c9-442d-af82-77f6232c9dd6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:07.074647 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-c75104c6-d8c9-442d-af82-77f6232c9dd6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:07.086879 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c75104c6-d8c9-442d-af82-77f6232c9dd6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:07.087915 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c75104c6-d8c9-442d-af82-77f6232c9dd6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:07.088343 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c75104c6-d8c9-442d-af82-77f6232c9dd6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:07.089053 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c75104c6-d8c9-442d-af82-77f6232c9dd6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:07.089515 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c75104c6-d8c9-442d-af82-77f6232c9dd6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:07.095358 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c75104c6-d8c9-442d-af82-77f6232c9dd6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:07.412166 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-2074262d-184a-465c-8a6b-3a15d08b8755 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0bf76838-b185-4fb9-9871-9911ebf27115"}} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:50:07.415044 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-2074262d-184a-465c-8a6b-3a15d08b8755 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:07.422887 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2074262d-184a-465c-8a6b-3a15d08b8755 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:07.423628 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2074262d-184a-465c-8a6b-3a15d08b8755 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:07.424438 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2074262d-184a-465c-8a6b-3a15d08b8755 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:07.425367 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2074262d-184a-465c-8a6b-3a15d08b8755 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:07.426041 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2074262d-184a-465c-8a6b-3a15d08b8755 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:07.426600 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2074262d-184a-465c-8a6b-3a15d08b8755 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:07.448698 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-c75104c6-d8c9-442d-af82-77f6232c9dd6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:07.463664 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-c75104c6-d8c9-442d-af82-77f6232c9dd6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1521 microversion: 2.1 time: 0.403030 Sep 03 03:50:07.464294 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 100/211] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:07 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1521 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:07.629336 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-4b0c44f0-645c-4c83-924e-990627065cc7 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:07.629979 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-4b0c44f0-645c-4c83-924e-990627065cc7 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:07.639295 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4b0c44f0-645c-4c83-924e-990627065cc7 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:07.639777 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4b0c44f0-645c-4c83-924e-990627065cc7 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:07.640207 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4b0c44f0-645c-4c83-924e-990627065cc7 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:07.640899 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4b0c44f0-645c-4c83-924e-990627065cc7 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:07.642471 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4b0c44f0-645c-4c83-924e-990627065cc7 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:07.642923 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4b0c44f0-645c-4c83-924e-990627065cc7 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:07.821060 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-4b0c44f0-645c-4c83-924e-990627065cc7 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:07.829288 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-4b0c44f0-645c-4c83-924e-990627065cc7 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:07.830561 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-4b0c44f0-645c-4c83-924e-990627065cc7 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:07.831869 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-4b0c44f0-645c-4c83-924e-990627065cc7 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1599 microversion: 2.20 time: 0.206632 Sep 03 03:50:07.832569 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 101/212] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:50:07 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1599 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 03:50:07.857497 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-480b2bb5-7642-438e-acb8-df9541a227f6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:07.857978 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-480b2bb5-7642-438e-acb8-df9541a227f6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:07.864020 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-480b2bb5-7642-438e-acb8-df9541a227f6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:07.864490 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-480b2bb5-7642-438e-acb8-df9541a227f6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:07.864909 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-480b2bb5-7642-438e-acb8-df9541a227f6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:07.865583 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-480b2bb5-7642-438e-acb8-df9541a227f6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:07.866021 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-480b2bb5-7642-438e-acb8-df9541a227f6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:07.866427 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-480b2bb5-7642-438e-acb8-df9541a227f6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:07.944728 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-480b2bb5-7642-438e-acb8-df9541a227f6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090761 Sep 03 03:50:07.945490 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 102/213] 10.222.0.25 () {60 vars in 1316 bytes} [Sat Sep 3 03:50:07 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 03 03:50:08.494460 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-ff1e4830-5c46-4083-a272-3f6c51594d6d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:08.497373 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-ff1e4830-5c46-4083-a272-3f6c51594d6d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:08.503656 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ff1e4830-5c46-4083-a272-3f6c51594d6d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:08.504271 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ff1e4830-5c46-4083-a272-3f6c51594d6d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:08.504797 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ff1e4830-5c46-4083-a272-3f6c51594d6d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:08.505572 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ff1e4830-5c46-4083-a272-3f6c51594d6d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:08.506129 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ff1e4830-5c46-4083-a272-3f6c51594d6d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:08.506780 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ff1e4830-5c46-4083-a272-3f6c51594d6d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:08.744289 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-ff1e4830-5c46-4083-a272-3f6c51594d6d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:08.755608 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-ff1e4830-5c46-4083-a272-3f6c51594d6d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1521 microversion: 2.1 time: 0.267467 Sep 03 03:50:08.756799 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 103/214] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:08 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:09.162535 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-076c5f35-1f80-41e6-8cd2-a842d6259152 req-c6b27e5f-f66e-495e-a815-bcff45d01d2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d61f1c-d865-4d0d-89a9-1f91f0f8bf78", "tag": "dc502e70-8b66-4849-929e-0879ed88e591"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:50:09.172483 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-076c5f35-1f80-41e6-8cd2-a842d6259152 req-c6b27e5f-f66e-495e-a815-bcff45d01d2f service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:09.172953 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-076c5f35-1f80-41e6-8cd2-a842d6259152 req-c6b27e5f-f66e-495e-a815-bcff45d01d2f service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:09.173555 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-076c5f35-1f80-41e6-8cd2-a842d6259152 req-c6b27e5f-f66e-495e-a815-bcff45d01d2f service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:09.187480 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-076c5f35-1f80-41e6-8cd2-a842d6259152 req-c6b27e5f-f66e-495e-a815-bcff45d01d2f service nova] Creating event network-changed:dc502e70-8b66-4849-929e-0879ed88e591 for instance 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 on hv-cinder-79966 Sep 03 03:50:09.193500 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-076c5f35-1f80-41e6-8cd2-a842d6259152 req-c6b27e5f-f66e-495e-a815-bcff45d01d2f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035354 Sep 03 03:50:09.195076 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 104/215] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 03:50:09.778646 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-ef48f6b7-4742-4a7c-b2e8-749f77d99efb tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:09.779418 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-ef48f6b7-4742-4a7c-b2e8-749f77d99efb tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:09.787064 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ef48f6b7-4742-4a7c-b2e8-749f77d99efb tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:09.787748 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ef48f6b7-4742-4a7c-b2e8-749f77d99efb tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:09.788353 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ef48f6b7-4742-4a7c-b2e8-749f77d99efb tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:09.789111 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ef48f6b7-4742-4a7c-b2e8-749f77d99efb tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:09.789642 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ef48f6b7-4742-4a7c-b2e8-749f77d99efb tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:09.790211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ef48f6b7-4742-4a7c-b2e8-749f77d99efb tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:09.923588 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-ef48f6b7-4742-4a7c-b2e8-749f77d99efb tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:09.931730 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-ef48f6b7-4742-4a7c-b2e8-749f77d99efb tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1521 microversion: 2.1 time: 0.157234 Sep 03 03:50:09.932384 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 105/216] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:09 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:50:10.953756 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-354f3e7c-c2d6-4c55-9a24-624423ececf9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:10.954362 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-354f3e7c-c2d6-4c55-9a24-624423ececf9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:10.961316 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-354f3e7c-c2d6-4c55-9a24-624423ececf9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:10.961799 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-354f3e7c-c2d6-4c55-9a24-624423ececf9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:10.962230 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-354f3e7c-c2d6-4c55-9a24-624423ececf9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:10.962956 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-354f3e7c-c2d6-4c55-9a24-624423ececf9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:10.963404 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-354f3e7c-c2d6-4c55-9a24-624423ececf9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:10.963824 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-354f3e7c-c2d6-4c55-9a24-624423ececf9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:11.097824 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-354f3e7c-c2d6-4c55-9a24-624423ececf9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:11.110563 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-354f3e7c-c2d6-4c55-9a24-624423ececf9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1521 microversion: 2.1 time: 0.160320 Sep 03 03:50:11.111485 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 106/217] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:10 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:12.133121 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-bac0b450-de1e-47e4-bbe2-9c6fb7707662 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:12.133741 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-bac0b450-de1e-47e4-bbe2-9c6fb7707662 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:12.140140 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bac0b450-de1e-47e4-bbe2-9c6fb7707662 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:12.140611 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bac0b450-de1e-47e4-bbe2-9c6fb7707662 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:12.141034 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bac0b450-de1e-47e4-bbe2-9c6fb7707662 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:12.141703 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bac0b450-de1e-47e4-bbe2-9c6fb7707662 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:12.142146 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bac0b450-de1e-47e4-bbe2-9c6fb7707662 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:12.142554 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bac0b450-de1e-47e4-bbe2-9c6fb7707662 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:12.269352 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-bac0b450-de1e-47e4-bbe2-9c6fb7707662 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:12.277413 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-bac0b450-de1e-47e4-bbe2-9c6fb7707662 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1521 microversion: 2.1 time: 0.148220 Sep 03 03:50:12.277987 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 107/218] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:12 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:13.299820 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-90ffc21a-3463-4435-9d08-cdc49a3c19fe tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:13.300361 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-90ffc21a-3463-4435-9d08-cdc49a3c19fe tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:13.306849 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-90ffc21a-3463-4435-9d08-cdc49a3c19fe tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:13.307359 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-90ffc21a-3463-4435-9d08-cdc49a3c19fe tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:13.307778 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-90ffc21a-3463-4435-9d08-cdc49a3c19fe tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:13.308460 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-90ffc21a-3463-4435-9d08-cdc49a3c19fe tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:13.308898 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-90ffc21a-3463-4435-9d08-cdc49a3c19fe tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:13.309310 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-90ffc21a-3463-4435-9d08-cdc49a3c19fe tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:13.454462 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-90ffc21a-3463-4435-9d08-cdc49a3c19fe tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:13.466052 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-90ffc21a-3463-4435-9d08-cdc49a3c19fe tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1521 microversion: 2.1 time: 0.169825 Sep 03 03:50:13.466798 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 108/219] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:13 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:13.926919 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:13.939599 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-2074262d-184a-465c-8a6b-3a15d08b8755 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "POST /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.532979 Sep 03 03:50:13.941033 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 112/220] 10.222.0.25 () {60 vars in 1323 bytes} [Sat Sep 3 03:50:07 2022] POST /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383/os-volume_attachments => generated 194 bytes in 6535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 03:50:14.492476 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-334d1cf9-aa3f-4aba-b148-195c8f86ab3c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:14.493371 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-334d1cf9-aa3f-4aba-b148-195c8f86ab3c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:14.501705 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-334d1cf9-aa3f-4aba-b148-195c8f86ab3c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:14.502335 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-334d1cf9-aa3f-4aba-b148-195c8f86ab3c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:14.502917 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-334d1cf9-aa3f-4aba-b148-195c8f86ab3c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:14.503852 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-334d1cf9-aa3f-4aba-b148-195c8f86ab3c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:14.504431 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-334d1cf9-aa3f-4aba-b148-195c8f86ab3c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:14.504978 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-334d1cf9-aa3f-4aba-b148-195c8f86ab3c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:14.642673 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-334d1cf9-aa3f-4aba-b148-195c8f86ab3c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:14.646429 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell1:SELECT=100 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:14.651452 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-334d1cf9-aa3f-4aba-b148-195c8f86ab3c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1521 microversion: 2.1 time: 0.164226 Sep 03 03:50:14.652010 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 109/221] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:14 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:15.114241 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-bb1e18ae-1544-4c25-bb48-959e4706a80a tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1707805320", "imageRef": "0af209bb-870a-4343-a9f9-de05883bb8dd", "flavorRef": "452", "networks": [{"uuid": "6bcb1a0b-8951-44fc-bce8-a3327924fd60"}]}} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:50:15.173222 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.network.neutron [None req-bb1e18ae-1544-4c25-bb48-959e4706a80a tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] validate_networks() for [('6bcb1a0b-8951-44fc-bce8-a3327924fd60', None, None, None, None, None)] {{(pid=132076) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 03:50:15.539923 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-bb1e18ae-1544-4c25-bb48-959e4706a80a tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Flavor limits 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 03:50:15.540372 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-bb1e18ae-1544-4c25-bb48-959e4706a80a tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Image limits 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 03:50:15.540837 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-bb1e18ae-1544-4c25-bb48-959e4706a80a tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Flavor pref 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 03:50:15.541238 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-bb1e18ae-1544-4c25-bb48-959e4706a80a tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Image pref 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 03:50:15.541646 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-bb1e18ae-1544-4c25-bb48-959e4706a80a tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 03:50:15.550957 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-bb1e18ae-1544-4c25-bb48-959e4706a80a tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:15.551430 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-bb1e18ae-1544-4c25-bb48-959e4706a80a tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:15.551854 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-bb1e18ae-1544-4c25-bb48-959e4706a80a tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:15.552563 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-bb1e18ae-1544-4c25-bb48-959e4706a80a tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:15.552997 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-bb1e18ae-1544-4c25-bb48-959e4706a80a tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:15.553390 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-bb1e18ae-1544-4c25-bb48-959e4706a80a tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:15.569938 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.quota [None req-bb1e18ae-1544-4c25-bb48-959e4706a80a tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Getting quotas for project 8dc12b2499eb4f8ab6f3e216b3f6ff3e. Resources: {'ram', 'instances', 'cores'} {{(pid=132076) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 03:50:15.573979 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.quota [None req-bb1e18ae-1544-4c25-bb48-959e4706a80a tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Getting quotas for user 658ef1a43f7d445a920e5c4f2b26e339 and project 8dc12b2499eb4f8ab6f3e216b3f6ff3e. Resources: {'ram', 'instances', 'cores'} {{(pid=132076) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 03:50:15.585137 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-bb1e18ae-1544-4c25-bb48-959e4706a80a tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Going to run 1 instances... {{(pid=132076) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 03:50:15.587466 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-bb1e18ae-1544-4c25-bb48-959e4706a80a tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: e4b3eb7f-64e7-4075-b266-a4bbdd04a68a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0af209bb-870a-4343-a9f9-de05883bb8dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132076) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 03:50:15.639799 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-bb1e18ae-1544-4c25-bb48-959e4706a80a tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529729 Sep 03 03:50:15.640665 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 113/222] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Sep 3 03:50:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 03:50:15.651406 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-401d2c16-5393-49ea-a644-54980c81d544 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:15.651998 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-401d2c16-5393-49ea-a644-54980c81d544 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: e4b3eb7f-64e7-4075-b266-a4bbdd04a68a] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:15.673586 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-60ad0866-6f26-4c25-b789-a3bcb5ff0979 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:15.674147 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-60ad0866-6f26-4c25-b789-a3bcb5ff0979 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:15.682149 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-60ad0866-6f26-4c25-b789-a3bcb5ff0979 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:15.682630 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-60ad0866-6f26-4c25-b789-a3bcb5ff0979 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:15.683091 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-60ad0866-6f26-4c25-b789-a3bcb5ff0979 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:15.683781 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-60ad0866-6f26-4c25-b789-a3bcb5ff0979 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:15.684229 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-60ad0866-6f26-4c25-b789-a3bcb5ff0979 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:15.684640 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-60ad0866-6f26-4c25-b789-a3bcb5ff0979 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:15.722194 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-401d2c16-5393-49ea-a644-54980c81d544 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ef1a43f7d445a920e5c4f2b26e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc12b2499eb4f8ab6f3e216b3f6ff3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:15.729508 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-401d2c16-5393-49ea-a644-54980c81d544 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a" status: 200 len: 1214 microversion: 2.1 time: 0.081703 Sep 03 03:50:15.735043 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 110/223] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:15 2022] GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:50:15.851545 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-60ad0866-6f26-4c25-b789-a3bcb5ff0979 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:15.860099 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-60ad0866-6f26-4c25-b789-a3bcb5ff0979 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1521 microversion: 2.1 time: 0.190308 Sep 03 03:50:15.861046 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 114/224] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:15 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:16.753951 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-7dbd6726-9c3d-4e6e-bb3f-d295410b145b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:16.754667 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-7dbd6726-9c3d-4e6e-bb3f-d295410b145b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: e4b3eb7f-64e7-4075-b266-a4bbdd04a68a] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:16.763114 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7dbd6726-9c3d-4e6e-bb3f-d295410b145b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:16.763599 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7dbd6726-9c3d-4e6e-bb3f-d295410b145b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:16.764023 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7dbd6726-9c3d-4e6e-bb3f-d295410b145b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:16.764685 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7dbd6726-9c3d-4e6e-bb3f-d295410b145b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:16.765125 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7dbd6726-9c3d-4e6e-bb3f-d295410b145b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:16.765572 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7dbd6726-9c3d-4e6e-bb3f-d295410b145b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:16.831003 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-7dbd6726-9c3d-4e6e-bb3f-d295410b145b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ef1a43f7d445a920e5c4f2b26e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc12b2499eb4f8ab6f3e216b3f6ff3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:16.838602 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-7dbd6726-9c3d-4e6e-bb3f-d295410b145b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a" status: 200 len: 1266 microversion: 2.1 time: 0.089926 Sep 03 03:50:16.839200 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 111/225] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:16 2022] GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:16.883380 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-908c6c34-76f5-4ab7-87be-25a18014826f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:16.883980 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-908c6c34-76f5-4ab7-87be-25a18014826f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:16.890517 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-908c6c34-76f5-4ab7-87be-25a18014826f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:16.891052 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-908c6c34-76f5-4ab7-87be-25a18014826f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:16.891512 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-908c6c34-76f5-4ab7-87be-25a18014826f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:16.892180 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-908c6c34-76f5-4ab7-87be-25a18014826f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:16.892622 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-908c6c34-76f5-4ab7-87be-25a18014826f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:16.893036 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-908c6c34-76f5-4ab7-87be-25a18014826f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:17.025001 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-908c6c34-76f5-4ab7-87be-25a18014826f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:17.032792 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-908c6c34-76f5-4ab7-87be-25a18014826f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1521 microversion: 2.1 time: 0.153183 Sep 03 03:50:17.033353 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 115/226] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:16 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:17.862791 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-70b8147e-aad0-4c3e-a031-845c88a537ec tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:17.863543 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-70b8147e-aad0-4c3e-a031-845c88a537ec tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: e4b3eb7f-64e7-4075-b266-a4bbdd04a68a] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:17.885607 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-70b8147e-aad0-4c3e-a031-845c88a537ec tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:17.886188 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-70b8147e-aad0-4c3e-a031-845c88a537ec tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:17.886498 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-70b8147e-aad0-4c3e-a031-845c88a537ec tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:17.887225 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-70b8147e-aad0-4c3e-a031-845c88a537ec tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:17.887663 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-70b8147e-aad0-4c3e-a031-845c88a537ec tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:17.888074 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-70b8147e-aad0-4c3e-a031-845c88a537ec tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:17.992546 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-70b8147e-aad0-4c3e-a031-845c88a537ec tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ef1a43f7d445a920e5c4f2b26e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc12b2499eb4f8ab6f3e216b3f6ff3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:18.001752 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-70b8147e-aad0-4c3e-a031-845c88a537ec tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a" status: 200 len: 1272 microversion: 2.1 time: 0.143503 Sep 03 03:50:18.002933 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 112/227] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:17 2022] GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a => generated 1272 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:18.057604 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-c5d7e054-28a6-449e-989e-19234ec11d0c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:18.058889 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-c5d7e054-28a6-449e-989e-19234ec11d0c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:18.067009 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c5d7e054-28a6-449e-989e-19234ec11d0c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:18.068103 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c5d7e054-28a6-449e-989e-19234ec11d0c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:18.068670 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c5d7e054-28a6-449e-989e-19234ec11d0c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:18.069631 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c5d7e054-28a6-449e-989e-19234ec11d0c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:18.070360 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c5d7e054-28a6-449e-989e-19234ec11d0c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:18.071126 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c5d7e054-28a6-449e-989e-19234ec11d0c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:18.373724 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-c5d7e054-28a6-449e-989e-19234ec11d0c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:18.381781 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-c5d7e054-28a6-449e-989e-19234ec11d0c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1521 microversion: 2.1 time: 0.328940 Sep 03 03:50:18.382363 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 116/228] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:18 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1521 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:19.025324 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-4ba12b47-5432-4f64-b4c7-fd6ddaf9a734 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:19.025955 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-4ba12b47-5432-4f64-b4c7-fd6ddaf9a734 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: e4b3eb7f-64e7-4075-b266-a4bbdd04a68a] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:19.032085 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4ba12b47-5432-4f64-b4c7-fd6ddaf9a734 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:19.032556 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4ba12b47-5432-4f64-b4c7-fd6ddaf9a734 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:19.032968 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4ba12b47-5432-4f64-b4c7-fd6ddaf9a734 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:19.033626 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4ba12b47-5432-4f64-b4c7-fd6ddaf9a734 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:19.034059 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4ba12b47-5432-4f64-b4c7-fd6ddaf9a734 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:19.034466 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4ba12b47-5432-4f64-b4c7-fd6ddaf9a734 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:19.166405 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-4ba12b47-5432-4f64-b4c7-fd6ddaf9a734 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ef1a43f7d445a920e5c4f2b26e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc12b2499eb4f8ab6f3e216b3f6ff3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:19.174040 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-4ba12b47-5432-4f64-b4c7-fd6ddaf9a734 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a" status: 200 len: 1314 microversion: 2.1 time: 0.152658 Sep 03 03:50:19.174682 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 113/229] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:19 2022] GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:19.405188 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-fcb2d0be-d032-4a26-bb40-0abd8650165d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:19.406439 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-fcb2d0be-d032-4a26-bb40-0abd8650165d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:19.413021 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fcb2d0be-d032-4a26-bb40-0abd8650165d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:19.413507 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fcb2d0be-d032-4a26-bb40-0abd8650165d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:19.413939 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fcb2d0be-d032-4a26-bb40-0abd8650165d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:19.414627 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fcb2d0be-d032-4a26-bb40-0abd8650165d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:19.415138 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fcb2d0be-d032-4a26-bb40-0abd8650165d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:19.415545 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fcb2d0be-d032-4a26-bb40-0abd8650165d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:19.545612 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-fcb2d0be-d032-4a26-bb40-0abd8650165d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:19.553239 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-fcb2d0be-d032-4a26-bb40-0abd8650165d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1521 microversion: 2.1 time: 0.151878 Sep 03 03:50:19.553811 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 117/230] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:19 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:20.196814 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-3f3f37a0-094a-4370-9c10-e620edf89d8e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:20.197562 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-3f3f37a0-094a-4370-9c10-e620edf89d8e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: e4b3eb7f-64e7-4075-b266-a4bbdd04a68a] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:20.203558 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3f3f37a0-094a-4370-9c10-e620edf89d8e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:20.204033 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3f3f37a0-094a-4370-9c10-e620edf89d8e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:20.204456 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3f3f37a0-094a-4370-9c10-e620edf89d8e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:20.205129 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3f3f37a0-094a-4370-9c10-e620edf89d8e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:20.205577 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3f3f37a0-094a-4370-9c10-e620edf89d8e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:20.205986 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3f3f37a0-094a-4370-9c10-e620edf89d8e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:20.339615 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-3f3f37a0-094a-4370-9c10-e620edf89d8e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ef1a43f7d445a920e5c4f2b26e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc12b2499eb4f8ab6f3e216b3f6ff3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:20.347895 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-3f3f37a0-094a-4370-9c10-e620edf89d8e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a" status: 200 len: 1314 microversion: 2.1 time: 0.154788 Sep 03 03:50:20.348511 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 114/231] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:20 2022] GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:20.577424 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-98173020-cd72-4769-b25a-5813fbf55f29 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:20.578110 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-98173020-cd72-4769-b25a-5813fbf55f29 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:20.585267 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-98173020-cd72-4769-b25a-5813fbf55f29 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:20.585890 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-98173020-cd72-4769-b25a-5813fbf55f29 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:20.586405 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-98173020-cd72-4769-b25a-5813fbf55f29 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:20.587399 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-98173020-cd72-4769-b25a-5813fbf55f29 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:20.587917 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-98173020-cd72-4769-b25a-5813fbf55f29 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:20.588601 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-98173020-cd72-4769-b25a-5813fbf55f29 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:20.795176 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-98173020-cd72-4769-b25a-5813fbf55f29 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:20.805493 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-98173020-cd72-4769-b25a-5813fbf55f29 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1521 microversion: 2.1 time: 0.232738 Sep 03 03:50:20.806763 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 118/232] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:20 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:21.003924 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-6d07af01-a23a-407b-9ed2-7193247a3c94 req-23354698-c8f0-4be0-b74a-e40b2aad771a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4b3eb7f-64e7-4075-b266-a4bbdd04a68a", "tag": "58924587-4065-4204-ba33-156d960078cd"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:50:21.013150 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-6d07af01-a23a-407b-9ed2-7193247a3c94 req-23354698-c8f0-4be0-b74a-e40b2aad771a service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:21.013610 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-6d07af01-a23a-407b-9ed2-7193247a3c94 req-23354698-c8f0-4be0-b74a-e40b2aad771a service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:21.013988 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-6d07af01-a23a-407b-9ed2-7193247a3c94 req-23354698-c8f0-4be0-b74a-e40b2aad771a service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:21.025203 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-6d07af01-a23a-407b-9ed2-7193247a3c94 req-23354698-c8f0-4be0-b74a-e40b2aad771a service nova] Creating event network-changed:58924587-4065-4204-ba33-156d960078cd for instance e4b3eb7f-64e7-4075-b266-a4bbdd04a68a on hv-cinder-79966 Sep 03 03:50:21.030075 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-6d07af01-a23a-407b-9ed2-7193247a3c94 req-23354698-c8f0-4be0-b74a-e40b2aad771a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029710 Sep 03 03:50:21.031010 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 115/233] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:50:21.371756 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-3d410d52-faea-4847-8a45-d35c5b5ca4c5 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:21.372401 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-3d410d52-faea-4847-8a45-d35c5b5ca4c5 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: e4b3eb7f-64e7-4075-b266-a4bbdd04a68a] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:21.378292 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3d410d52-faea-4847-8a45-d35c5b5ca4c5 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:21.378750 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3d410d52-faea-4847-8a45-d35c5b5ca4c5 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:21.379207 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3d410d52-faea-4847-8a45-d35c5b5ca4c5 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:21.379926 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3d410d52-faea-4847-8a45-d35c5b5ca4c5 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:21.380371 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3d410d52-faea-4847-8a45-d35c5b5ca4c5 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:21.380780 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3d410d52-faea-4847-8a45-d35c5b5ca4c5 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:21.527480 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-3d410d52-faea-4847-8a45-d35c5b5ca4c5 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ef1a43f7d445a920e5c4f2b26e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc12b2499eb4f8ab6f3e216b3f6ff3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:21.535258 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-3d410d52-faea-4847-8a45-d35c5b5ca4c5 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a" status: 200 len: 1314 microversion: 2.1 time: 0.167400 Sep 03 03:50:21.535820 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 119/234] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:21 2022] GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:21.832102 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-c9261761-8e82-46d3-b5ab-e9900770cb2f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:21.833147 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-c9261761-8e82-46d3-b5ab-e9900770cb2f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:21.840223 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c9261761-8e82-46d3-b5ab-e9900770cb2f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:21.840692 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c9261761-8e82-46d3-b5ab-e9900770cb2f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:21.841110 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c9261761-8e82-46d3-b5ab-e9900770cb2f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:21.841775 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c9261761-8e82-46d3-b5ab-e9900770cb2f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:21.842214 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c9261761-8e82-46d3-b5ab-e9900770cb2f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:21.842591 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c9261761-8e82-46d3-b5ab-e9900770cb2f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:21.979734 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-c9261761-8e82-46d3-b5ab-e9900770cb2f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:21.987758 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-c9261761-8e82-46d3-b5ab-e9900770cb2f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1521 microversion: 2.1 time: 0.160601 Sep 03 03:50:21.988322 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 116/235] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:21 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:22.558364 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-bf5d6bf7-a584-4e4c-b728-b1f25243c03b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:22.559506 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-bf5d6bf7-a584-4e4c-b728-b1f25243c03b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: e4b3eb7f-64e7-4075-b266-a4bbdd04a68a] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:22.566206 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-bf5d6bf7-a584-4e4c-b728-b1f25243c03b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:22.566676 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-bf5d6bf7-a584-4e4c-b728-b1f25243c03b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:22.567315 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-bf5d6bf7-a584-4e4c-b728-b1f25243c03b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:22.568019 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-bf5d6bf7-a584-4e4c-b728-b1f25243c03b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:22.568458 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-bf5d6bf7-a584-4e4c-b728-b1f25243c03b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:22.568867 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-bf5d6bf7-a584-4e4c-b728-b1f25243c03b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:22.709368 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-bf5d6bf7-a584-4e4c-b728-b1f25243c03b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ef1a43f7d445a920e5c4f2b26e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc12b2499eb4f8ab6f3e216b3f6ff3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:22.719099 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-bf5d6bf7-a584-4e4c-b728-b1f25243c03b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a" status: 200 len: 1314 microversion: 2.1 time: 0.164809 Sep 03 03:50:22.721340 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 120/236] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:22 2022] GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:23.010442 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-a5774118-239c-40b9-8d66-1e291f3f1be9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:23.011789 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-a5774118-239c-40b9-8d66-1e291f3f1be9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:23.018859 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a5774118-239c-40b9-8d66-1e291f3f1be9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:23.019811 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a5774118-239c-40b9-8d66-1e291f3f1be9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:23.020573 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a5774118-239c-40b9-8d66-1e291f3f1be9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:23.021546 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a5774118-239c-40b9-8d66-1e291f3f1be9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:23.022115 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a5774118-239c-40b9-8d66-1e291f3f1be9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:23.022596 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a5774118-239c-40b9-8d66-1e291f3f1be9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:23.161652 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a5774118-239c-40b9-8d66-1e291f3f1be9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:23.170333 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-a5774118-239c-40b9-8d66-1e291f3f1be9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1521 microversion: 2.1 time: 0.163580 Sep 03 03:50:23.171169 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 117/237] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:23 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:23.755303 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-581d8e96-9a25-4978-b8f3-8dee4821fc7e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:23.755303 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-581d8e96-9a25-4978-b8f3-8dee4821fc7e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: e4b3eb7f-64e7-4075-b266-a4bbdd04a68a] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:23.756614 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-581d8e96-9a25-4978-b8f3-8dee4821fc7e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:23.758691 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-581d8e96-9a25-4978-b8f3-8dee4821fc7e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:23.759438 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-581d8e96-9a25-4978-b8f3-8dee4821fc7e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:23.761264 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-581d8e96-9a25-4978-b8f3-8dee4821fc7e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:23.766038 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-581d8e96-9a25-4978-b8f3-8dee4821fc7e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:23.766509 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-581d8e96-9a25-4978-b8f3-8dee4821fc7e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:23.798679 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-b363ddb5-ce74-47d3-99fb-c229969cb754 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:23.799227 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-b363ddb5-ce74-47d3-99fb-c229969cb754 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:23.805264 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b363ddb5-ce74-47d3-99fb-c229969cb754 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:23.805758 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b363ddb5-ce74-47d3-99fb-c229969cb754 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:23.806191 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b363ddb5-ce74-47d3-99fb-c229969cb754 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:23.806926 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b363ddb5-ce74-47d3-99fb-c229969cb754 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:23.807388 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b363ddb5-ce74-47d3-99fb-c229969cb754 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:23.807793 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b363ddb5-ce74-47d3-99fb-c229969cb754 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:23.836321 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-b363ddb5-ce74-47d3-99fb-c229969cb754 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Going to try to terminate instance {{(pid=132077) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 03:50:23.935248 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-b363ddb5-ce74-47d3-99fb-c229969cb754 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 204 len: 0 microversion: 2.1 time: 0.139989 Sep 03 03:50:23.935810 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 118/238] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Sep 3 03:50:23 2022] DELETE /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 03 03:50:23.944941 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-0b7a1e87-0aaf-459b-889c-f250b07211e2 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:23.945621 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-0b7a1e87-0aaf-459b-889c-f250b07211e2 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:23.951773 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0b7a1e87-0aaf-459b-889c-f250b07211e2 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:23.952250 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0b7a1e87-0aaf-459b-889c-f250b07211e2 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:23.952677 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0b7a1e87-0aaf-459b-889c-f250b07211e2 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:23.953357 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0b7a1e87-0aaf-459b-889c-f250b07211e2 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:23.953884 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0b7a1e87-0aaf-459b-889c-f250b07211e2 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:23.954209 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0b7a1e87-0aaf-459b-889c-f250b07211e2 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:23.981399 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-581d8e96-9a25-4978-b8f3-8dee4821fc7e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ef1a43f7d445a920e5c4f2b26e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc12b2499eb4f8ab6f3e216b3f6ff3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:23.990542 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-581d8e96-9a25-4978-b8f3-8dee4821fc7e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a" status: 200 len: 1314 microversion: 2.1 time: 0.250609 Sep 03 03:50:23.991138 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 121/239] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:23 2022] GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:24.088200 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-0b7a1e87-0aaf-459b-889c-f250b07211e2 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a959dec6c0c944aea231b65612892705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968cc9376f884f67b20b91547211fffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:24.096953 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-0b7a1e87-0aaf-459b-889c-f250b07211e2 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 200 len: 1554 microversion: 2.1 time: 0.156312 Sep 03 03:50:24.097559 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 119/240] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:23 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:50:24.192766 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-96935efe-fd68-4b4d-89ae-e4197d4795f5 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:24.193353 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-96935efe-fd68-4b4d-89ae-e4197d4795f5 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:24.199641 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-96935efe-fd68-4b4d-89ae-e4197d4795f5 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:24.200120 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-96935efe-fd68-4b4d-89ae-e4197d4795f5 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:24.200543 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-96935efe-fd68-4b4d-89ae-e4197d4795f5 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:24.201222 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-96935efe-fd68-4b4d-89ae-e4197d4795f5 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:24.201671 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-96935efe-fd68-4b4d-89ae-e4197d4795f5 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:24.202085 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-96935efe-fd68-4b4d-89ae-e4197d4795f5 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:24.330078 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-96935efe-fd68-4b4d-89ae-e4197d4795f5 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:24.337999 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-96935efe-fd68-4b4d-89ae-e4197d4795f5 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1521 microversion: 2.1 time: 0.149208 Sep 03 03:50:24.338576 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 122/241] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:24 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:25.013370 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-ddf5c2a7-ca67-4d04-8a00-9750645dc7df tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:25.013968 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-ddf5c2a7-ca67-4d04-8a00-9750645dc7df tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: e4b3eb7f-64e7-4075-b266-a4bbdd04a68a] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:25.019983 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ddf5c2a7-ca67-4d04-8a00-9750645dc7df tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:25.020452 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ddf5c2a7-ca67-4d04-8a00-9750645dc7df tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:25.020870 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ddf5c2a7-ca67-4d04-8a00-9750645dc7df tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:25.021766 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ddf5c2a7-ca67-4d04-8a00-9750645dc7df tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:25.022209 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ddf5c2a7-ca67-4d04-8a00-9750645dc7df tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:25.022793 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ddf5c2a7-ca67-4d04-8a00-9750645dc7df tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:25.121038 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-d093191d-2bb1-492e-8ed8-5e0d51ac007b tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:25.121631 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-d093191d-2bb1-492e-8ed8-5e0d51ac007b tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:25.128420 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d093191d-2bb1-492e-8ed8-5e0d51ac007b tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:25.128971 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d093191d-2bb1-492e-8ed8-5e0d51ac007b tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:25.129479 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d093191d-2bb1-492e-8ed8-5e0d51ac007b tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:25.130657 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d093191d-2bb1-492e-8ed8-5e0d51ac007b tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:25.131312 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d093191d-2bb1-492e-8ed8-5e0d51ac007b tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:25.131726 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d093191d-2bb1-492e-8ed8-5e0d51ac007b tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:25.166317 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-ddf5c2a7-ca67-4d04-8a00-9750645dc7df tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ef1a43f7d445a920e5c4f2b26e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc12b2499eb4f8ab6f3e216b3f6ff3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:25.175533 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-ddf5c2a7-ca67-4d04-8a00-9750645dc7df tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a" status: 200 len: 1314 microversion: 2.1 time: 0.165719 Sep 03 03:50:25.176138 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 120/242] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:25 2022] GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:25.276885 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-d093191d-2bb1-492e-8ed8-5e0d51ac007b tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a959dec6c0c944aea231b65612892705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968cc9376f884f67b20b91547211fffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:25.285468 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-d093191d-2bb1-492e-8ed8-5e0d51ac007b tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 200 len: 1554 microversion: 2.1 time: 0.168831 Sep 03 03:50:25.286065 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 123/243] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:25 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:25.360760 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-bf85d8d6-a3e9-4e25-99c5-d41db9911120 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:25.361350 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-bf85d8d6-a3e9-4e25-99c5-d41db9911120 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:25.367393 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bf85d8d6-a3e9-4e25-99c5-d41db9911120 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:25.367864 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bf85d8d6-a3e9-4e25-99c5-d41db9911120 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:25.368289 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bf85d8d6-a3e9-4e25-99c5-d41db9911120 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:25.368961 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bf85d8d6-a3e9-4e25-99c5-d41db9911120 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:25.369399 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bf85d8d6-a3e9-4e25-99c5-d41db9911120 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:25.369814 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bf85d8d6-a3e9-4e25-99c5-d41db9911120 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:25.504762 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-bf85d8d6-a3e9-4e25-99c5-d41db9911120 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:25.513438 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-bf85d8d6-a3e9-4e25-99c5-d41db9911120 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1521 microversion: 2.1 time: 0.156735 Sep 03 03:50:25.513967 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 121/244] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:25 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:26.199155 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-4e8567bd-1555-426f-afa9-79775e6f4ab0 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:26.199846 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-4e8567bd-1555-426f-afa9-79775e6f4ab0 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: e4b3eb7f-64e7-4075-b266-a4bbdd04a68a] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:26.202106 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell0:SELECT=2 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:26.203125 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell0:SELECT=6 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:26.211401 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4e8567bd-1555-426f-afa9-79775e6f4ab0 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:26.212039 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4e8567bd-1555-426f-afa9-79775e6f4ab0 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:26.212627 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4e8567bd-1555-426f-afa9-79775e6f4ab0 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:26.213644 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4e8567bd-1555-426f-afa9-79775e6f4ab0 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:26.214281 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4e8567bd-1555-426f-afa9-79775e6f4ab0 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:26.214694 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4e8567bd-1555-426f-afa9-79775e6f4ab0 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:26.317054 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-ec94a13a-f667-40bf-8b38-d0977ce7fa75 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:26.317834 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-ec94a13a-f667-40bf-8b38-d0977ce7fa75 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:26.320019 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell0:SELECT=2 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:26.325357 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ec94a13a-f667-40bf-8b38-d0977ce7fa75 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:26.325943 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ec94a13a-f667-40bf-8b38-d0977ce7fa75 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:26.326470 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ec94a13a-f667-40bf-8b38-d0977ce7fa75 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:26.327267 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ec94a13a-f667-40bf-8b38-d0977ce7fa75 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:26.327816 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ec94a13a-f667-40bf-8b38-d0977ce7fa75 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:26.328379 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ec94a13a-f667-40bf-8b38-d0977ce7fa75 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:26.361407 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-4e8567bd-1555-426f-afa9-79775e6f4ab0 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ef1a43f7d445a920e5c4f2b26e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc12b2499eb4f8ab6f3e216b3f6ff3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:26.370095 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-4e8567bd-1555-426f-afa9-79775e6f4ab0 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a" status: 200 len: 1314 microversion: 2.1 time: 0.175433 Sep 03 03:50:26.371237 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 124/245] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:26 2022] GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:26.459102 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-ec94a13a-f667-40bf-8b38-d0977ce7fa75 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a959dec6c0c944aea231b65612892705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968cc9376f884f67b20b91547211fffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:26.467604 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-ec94a13a-f667-40bf-8b38-d0977ce7fa75 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 200 len: 1554 microversion: 2.1 time: 0.154479 Sep 03 03:50:26.468605 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 122/246] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:26 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:26.536277 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-5a0ffe46-7999-47c6-a9ce-42217229e0a0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:26.536844 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-5a0ffe46-7999-47c6-a9ce-42217229e0a0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:26.543063 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5a0ffe46-7999-47c6-a9ce-42217229e0a0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:26.543571 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5a0ffe46-7999-47c6-a9ce-42217229e0a0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:26.543995 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5a0ffe46-7999-47c6-a9ce-42217229e0a0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:26.544642 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5a0ffe46-7999-47c6-a9ce-42217229e0a0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:26.545117 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5a0ffe46-7999-47c6-a9ce-42217229e0a0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:26.545554 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5a0ffe46-7999-47c6-a9ce-42217229e0a0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:26.681357 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-5a0ffe46-7999-47c6-a9ce-42217229e0a0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:26.689152 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-5a0ffe46-7999-47c6-a9ce-42217229e0a0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1521 microversion: 2.1 time: 0.156705 Sep 03 03:50:26.689945 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 125/247] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:26 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:27.392357 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-3aa12fc5-c7d8-40ac-a129-3987bdebc215 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:27.392937 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-3aa12fc5-c7d8-40ac-a129-3987bdebc215 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: e4b3eb7f-64e7-4075-b266-a4bbdd04a68a] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:27.398463 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:27.400160 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3aa12fc5-c7d8-40ac-a129-3987bdebc215 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:27.400639 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3aa12fc5-c7d8-40ac-a129-3987bdebc215 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:27.401863 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3aa12fc5-c7d8-40ac-a129-3987bdebc215 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:27.402543 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3aa12fc5-c7d8-40ac-a129-3987bdebc215 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:27.403204 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3aa12fc5-c7d8-40ac-a129-3987bdebc215 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:27.403751 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3aa12fc5-c7d8-40ac-a129-3987bdebc215 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:27.492483 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-1f2cb0c0-a03b-4a36-be94-1000f3a01836 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:27.493290 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-1f2cb0c0-a03b-4a36-be94-1000f3a01836 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:27.500103 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1f2cb0c0-a03b-4a36-be94-1000f3a01836 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:27.500667 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1f2cb0c0-a03b-4a36-be94-1000f3a01836 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:27.501323 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1f2cb0c0-a03b-4a36-be94-1000f3a01836 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:27.502137 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1f2cb0c0-a03b-4a36-be94-1000f3a01836 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:27.503040 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1f2cb0c0-a03b-4a36-be94-1000f3a01836 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:27.503494 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1f2cb0c0-a03b-4a36-be94-1000f3a01836 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:27.602097 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-3aa12fc5-c7d8-40ac-a129-3987bdebc215 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ef1a43f7d445a920e5c4f2b26e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc12b2499eb4f8ab6f3e216b3f6ff3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:27.611714 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-3aa12fc5-c7d8-40ac-a129-3987bdebc215 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a" status: 200 len: 1314 microversion: 2.1 time: 0.223117 Sep 03 03:50:27.612443 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 123/248] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:27 2022] GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:27.716883 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-f921868a-9d97-4210-97bb-3604bde64534 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:27.719145 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-f921868a-9d97-4210-97bb-3604bde64534 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:27.726427 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f921868a-9d97-4210-97bb-3604bde64534 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:27.727199 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f921868a-9d97-4210-97bb-3604bde64534 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:27.728231 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f921868a-9d97-4210-97bb-3604bde64534 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:27.729240 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f921868a-9d97-4210-97bb-3604bde64534 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:27.729984 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f921868a-9d97-4210-97bb-3604bde64534 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:27.730644 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f921868a-9d97-4210-97bb-3604bde64534 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:27.832501 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-1f2cb0c0-a03b-4a36-be94-1000f3a01836 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a959dec6c0c944aea231b65612892705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968cc9376f884f67b20b91547211fffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:27.849561 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-1f2cb0c0-a03b-4a36-be94-1000f3a01836 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 200 len: 1554 microversion: 2.1 time: 0.362131 Sep 03 03:50:27.852663 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 126/249] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:27 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 1554 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:50:27.967318 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-f921868a-9d97-4210-97bb-3604bde64534 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:27.980565 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-f921868a-9d97-4210-97bb-3604bde64534 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1521 microversion: 2.1 time: 0.270291 Sep 03 03:50:27.983895 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 124/250] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:27 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:28.574059 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-34afeca8-d4e7-49ff-bb1f-1f7282deb634 req-7a467cd4-a547-4cee-8098-ca8909cfa5a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5154156-831e-45fa-b20b-3c6bd4f1f383", "name": "network-vif-deleted", "tag": "45d48f27-6986-4559-b518-e64ca4982470"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:50:28.590664 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:28.601920 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-34afeca8-d4e7-49ff-bb1f-1f7282deb634 req-7a467cd4-a547-4cee-8098-ca8909cfa5a0 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:28.602690 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-34afeca8-d4e7-49ff-bb1f-1f7282deb634 req-7a467cd4-a547-4cee-8098-ca8909cfa5a0 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:28.603403 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-34afeca8-d4e7-49ff-bb1f-1f7282deb634 req-7a467cd4-a547-4cee-8098-ca8909cfa5a0 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:28.620610 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-34afeca8-d4e7-49ff-bb1f-1f7282deb634 req-7a467cd4-a547-4cee-8098-ca8909cfa5a0 service nova] Creating event network-vif-deleted:45d48f27-6986-4559-b518-e64ca4982470 for instance e5154156-831e-45fa-b20b-3c6bd4f1f383 on hv-cinder-79966 Sep 03 03:50:28.628443 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-34afeca8-d4e7-49ff-bb1f-1f7282deb634 req-7a467cd4-a547-4cee-8098-ca8909cfa5a0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064255 Sep 03 03:50:28.636224 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 127/251] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:50:28.640051 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-f3bf57c2-e1cb-4786-a6ab-c5ef76e7e09a tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:28.641408 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-f3bf57c2-e1cb-4786-a6ab-c5ef76e7e09a tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: e4b3eb7f-64e7-4075-b266-a4bbdd04a68a] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:28.666690 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f3bf57c2-e1cb-4786-a6ab-c5ef76e7e09a tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:28.667854 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f3bf57c2-e1cb-4786-a6ab-c5ef76e7e09a tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:28.668539 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f3bf57c2-e1cb-4786-a6ab-c5ef76e7e09a tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:28.669819 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f3bf57c2-e1cb-4786-a6ab-c5ef76e7e09a tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:28.670468 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f3bf57c2-e1cb-4786-a6ab-c5ef76e7e09a tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:28.671131 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f3bf57c2-e1cb-4786-a6ab-c5ef76e7e09a tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:28.849342 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-f3bf57c2-e1cb-4786-a6ab-c5ef76e7e09a tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ef1a43f7d445a920e5c4f2b26e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc12b2499eb4f8ab6f3e216b3f6ff3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:28.858576 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-f3bf57c2-e1cb-4786-a6ab-c5ef76e7e09a tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a" status: 200 len: 1314 microversion: 2.1 time: 0.224733 Sep 03 03:50:28.868275 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 125/252] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:28 2022] GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:28.884906 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-0950f31b-1714-4bfa-9202-2b7de716da55 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:28.886796 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-0950f31b-1714-4bfa-9202-2b7de716da55 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:28.897305 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0950f31b-1714-4bfa-9202-2b7de716da55 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:28.898375 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0950f31b-1714-4bfa-9202-2b7de716da55 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:28.899420 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0950f31b-1714-4bfa-9202-2b7de716da55 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:28.900365 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0950f31b-1714-4bfa-9202-2b7de716da55 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:28.901027 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0950f31b-1714-4bfa-9202-2b7de716da55 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:28.901686 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0950f31b-1714-4bfa-9202-2b7de716da55 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:28.978698 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-0950f31b-1714-4bfa-9202-2b7de716da55 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a959dec6c0c944aea231b65612892705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '968cc9376f884f67b20b91547211fffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:28.988651 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-0950f31b-1714-4bfa-9202-2b7de716da55 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 200 len: 1345 microversion: 2.1 time: 0.108078 Sep 03 03:50:28.989904 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 128/253] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:28 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 1345 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:29.009273 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-7b3d444e-d22b-46ca-ae35-dfe4f701be5c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:29.010458 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-7b3d444e-d22b-46ca-ae35-dfe4f701be5c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:29.016791 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7b3d444e-d22b-46ca-ae35-dfe4f701be5c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:29.017557 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7b3d444e-d22b-46ca-ae35-dfe4f701be5c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:29.018058 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7b3d444e-d22b-46ca-ae35-dfe4f701be5c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:29.018761 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7b3d444e-d22b-46ca-ae35-dfe4f701be5c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:29.019241 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7b3d444e-d22b-46ca-ae35-dfe4f701be5c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:29.019949 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7b3d444e-d22b-46ca-ae35-dfe4f701be5c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:29.043651 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:29.198192 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-7b3d444e-d22b-46ca-ae35-dfe4f701be5c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:29.211189 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-7b3d444e-d22b-46ca-ae35-dfe4f701be5c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1521 microversion: 2.1 time: 0.207248 Sep 03 03:50:29.212287 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 126/254] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:29 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:29.888475 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-a8a11112-dcdc-4a4a-82fe-c5ef9b0deba7 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:29.889100 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-a8a11112-dcdc-4a4a-82fe-c5ef9b0deba7 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: e4b3eb7f-64e7-4075-b266-a4bbdd04a68a] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:29.896053 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a8a11112-dcdc-4a4a-82fe-c5ef9b0deba7 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:29.896536 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a8a11112-dcdc-4a4a-82fe-c5ef9b0deba7 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:29.896968 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a8a11112-dcdc-4a4a-82fe-c5ef9b0deba7 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:29.897722 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a8a11112-dcdc-4a4a-82fe-c5ef9b0deba7 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:29.898218 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a8a11112-dcdc-4a4a-82fe-c5ef9b0deba7 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:29.898636 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a8a11112-dcdc-4a4a-82fe-c5ef9b0deba7 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:30.012543 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-c58e0a75-456f-4f28-8e18-e7cfda466140 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:30.013259 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-c58e0a75-456f-4f28-8e18-e7cfda466140 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:30.019513 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c58e0a75-456f-4f28-8e18-e7cfda466140 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:30.020256 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c58e0a75-456f-4f28-8e18-e7cfda466140 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:30.020877 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c58e0a75-456f-4f28-8e18-e7cfda466140 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:30.021749 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c58e0a75-456f-4f28-8e18-e7cfda466140 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:30.022408 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c58e0a75-456f-4f28-8e18-e7cfda466140 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:30.023046 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c58e0a75-456f-4f28-8e18-e7cfda466140 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:30.027290 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-a8a11112-dcdc-4a4a-82fe-c5ef9b0deba7 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ef1a43f7d445a920e5c4f2b26e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc12b2499eb4f8ab6f3e216b3f6ff3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:30.036496 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-a8a11112-dcdc-4a4a-82fe-c5ef9b0deba7 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a" status: 200 len: 1314 microversion: 2.1 time: 0.152895 Sep 03 03:50:30.037066 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 129/255] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:29 2022] GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:30.047752 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.wsgi [None req-c58e0a75-456f-4f28-8e18-e7cfda466140 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] HTTP exception thrown: Instance e5154156-831e-45fa-b20b-3c6bd4f1f383 could not be found. Sep 03 03:50:30.047752 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-c58e0a75-456f-4f28-8e18-e7cfda466140 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Request method failure captured: Sep 03 03:50:30.047752 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: request: GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 HTTP/1.1 Sep 03 03:50:30.047752 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept: application/json Sep 03 03:50:30.047752 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept-Encoding: identity Sep 03 03:50:30.047752 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Connection: close Sep 03 03:50:30.047752 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Length: 0 Sep 03 03:50:30.047752 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Type: application/json Sep 03 03:50:30.047752 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Host: 10.222.0.25 Sep 03 03:50:30.047752 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Openstack-System-Scope: None Sep 03 03:50:30.047752 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: User-Agent: python-urllib3/1.26.12 Sep 03 03:50:30.047752 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Auth-Token: gAAAAABjEs67akeM6yHhm1WPjiUX1l9SeiXrugEK3Ifnt_mzqop8akNxAmVffBLzrmxQY2iNA-jRgt0X5YsgkeXFqz-LH7rasBVmw0pn_EvsCVUB03eUjuQ3J5MygZcyLFBY4NKqFp3mdpY3sYamYFZFz-Clq0jgYbYzVYXfAGuhVdmweR3cRHE Sep 03 03:50:30.047752 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Id: None Sep 03 03:50:30.047752 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Name: None Sep 03 03:50:30.047752 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Identity-Status: Confirmed Sep 03 03:50:30.047752 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Is-Admin-Project: True Sep 03 03:50:30.047752 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Id: default Sep 03 03:50:30.047752 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Name: Default Sep 03 03:50:30.047752 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Id: 968cc9376f884f67b20b91547211fffd Sep 03 03:50:30.047752 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Name: tempest-DeleteServersTestJSON-1785368639 Sep 03 03:50:30.047752 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Role: member,reader Sep 03 03:50:30.047752 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Roles: member,reader Sep 03 03:50:30.049505 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/968cc9376f884f67b20b91547211fffd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_968cc9376f884f67b20b91547211fffd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/968cc9376f884f67b20b91547211fffd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/968cc9376f884f67b20b91547211fffd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:50:30.049505 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant: tempest-DeleteServersTestJSON-1785368639 Sep 03 03:50:30.049505 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Id: 968cc9376f884f67b20b91547211fffd Sep 03 03:50:30.049505 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Name: tempest-DeleteServersTestJSON-1785368639 Sep 03 03:50:30.049505 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User: tempest-DeleteServersTestJSON-1785368639-project Sep 03 03:50:30.049505 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Id: default Sep 03 03:50:30.049505 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Name: Default Sep 03 03:50:30.049505 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Id: a959dec6c0c944aea231b65612892705 Sep 03 03:50:30.049505 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Name: tempest-DeleteServersTestJSON-1785368639-project Sep 03 03:50:30.049505 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: method: > Sep 03 03:50:30.049505 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: exception: Instance e5154156-831e-45fa-b20b-3c6bd4f1f383 could not be found. Sep 03 03:50:30.049505 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: action_args: {'id': 'e5154156-831e-45fa-b20b-3c6bd4f1f383'} Sep 03 03:50:30.050343 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:50:30.050343 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:50:30.050343 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 03:50:30.050343 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 03:50:30.050343 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 03:50:30.050343 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 03:50:30.050343 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 03:50:30.050343 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 03:50:30.050343 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 03:50:30.050343 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 03:50:30.050343 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5154156-831e-45fa-b20b-3c6bd4f1f383 could not be found. Sep 03 03:50:30.050343 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:50:30.050343 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:50:30.050343 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:50:30.050343 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:50:30.050343 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:50:30.050343 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:50:30.050343 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:50:30.050343 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:50:30.050343 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:50:30.051852 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:50:30.051852 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 03:50:30.051852 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 03:50:30.051852 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 03:50:30.051852 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 03:50:30.051852 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 03:50:30.051852 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:50:30.051852 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5154156-831e-45fa-b20b-3c6bd4f1f383 could not be found. Sep 03 03:50:30.051852 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:50:30.051852 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:50:30.051852 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:50:30.051852 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:50:30.051852 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:50:30.051852 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:50:30.051852 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:50:30.051852 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:50:30.051852 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5154156-831e-45fa-b20b-3c6bd4f1f383 could not be found. Sep 03 03:50:30.051852 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:50:30.053469 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-c58e0a75-456f-4f28-8e18-e7cfda466140 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Returning 404 to user: Instance e5154156-831e-45fa-b20b-3c6bd4f1f383 could not be found. {{(pid=132077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:50:30.053469 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-c58e0a75-456f-4f28-8e18-e7cfda466140 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 404 len: 111 microversion: 2.1 time: 0.035852 Sep 03 03:50:30.053469 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 127/256] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:30 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 03:50:30.172839 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-b3e37ea6-7c3b-4058-9a1b-38b16c61f7ab tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:30.175187 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-b3e37ea6-7c3b-4058-9a1b-38b16c61f7ab tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:30.181270 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b3e37ea6-7c3b-4058-9a1b-38b16c61f7ab tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:30.181739 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b3e37ea6-7c3b-4058-9a1b-38b16c61f7ab tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:30.182158 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b3e37ea6-7c3b-4058-9a1b-38b16c61f7ab tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:30.182850 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b3e37ea6-7c3b-4058-9a1b-38b16c61f7ab tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:30.183291 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b3e37ea6-7c3b-4058-9a1b-38b16c61f7ab tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:30.183702 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b3e37ea6-7c3b-4058-9a1b-38b16c61f7ab tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:30.196712 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.wsgi [None req-b3e37ea6-7c3b-4058-9a1b-38b16c61f7ab tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] HTTP exception thrown: Instance e5154156-831e-45fa-b20b-3c6bd4f1f383 could not be found. Sep 03 03:50:30.204375 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-b3e37ea6-7c3b-4058-9a1b-38b16c61f7ab tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Request method failure captured: Sep 03 03:50:30.204375 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: request: GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383/os-volume_attachments HTTP/1.1 Sep 03 03:50:30.204375 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept: application/json Sep 03 03:50:30.204375 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept-Encoding: identity Sep 03 03:50:30.204375 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Connection: close Sep 03 03:50:30.204375 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Length: 0 Sep 03 03:50:30.204375 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Type: application/json Sep 03 03:50:30.204375 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Host: 10.222.0.25 Sep 03 03:50:30.204375 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Openstack-System-Scope: None Sep 03 03:50:30.204375 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: User-Agent: python-urllib3/1.26.12 Sep 03 03:50:30.204375 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Auth-Token: gAAAAABjEs67akeM6yHhm1WPjiUX1l9SeiXrugEK3Ifnt_mzqop8akNxAmVffBLzrmxQY2iNA-jRgt0X5YsgkeXFqz-LH7rasBVmw0pn_EvsCVUB03eUjuQ3J5MygZcyLFBY4NKqFp3mdpY3sYamYFZFz-Clq0jgYbYzVYXfAGuhVdmweR3cRHE Sep 03 03:50:30.204375 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Id: None Sep 03 03:50:30.204375 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Name: None Sep 03 03:50:30.204375 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Identity-Status: Confirmed Sep 03 03:50:30.204375 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Is-Admin-Project: True Sep 03 03:50:30.204375 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Id: default Sep 03 03:50:30.204375 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Name: Default Sep 03 03:50:30.204375 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Id: 968cc9376f884f67b20b91547211fffd Sep 03 03:50:30.204375 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Name: tempest-DeleteServersTestJSON-1785368639 Sep 03 03:50:30.204375 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Role: member,reader Sep 03 03:50:30.204375 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Roles: member,reader Sep 03 03:50:30.206257 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/968cc9376f884f67b20b91547211fffd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_968cc9376f884f67b20b91547211fffd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/968cc9376f884f67b20b91547211fffd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/968cc9376f884f67b20b91547211fffd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:50:30.206257 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant: tempest-DeleteServersTestJSON-1785368639 Sep 03 03:50:30.206257 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Id: 968cc9376f884f67b20b91547211fffd Sep 03 03:50:30.206257 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Name: tempest-DeleteServersTestJSON-1785368639 Sep 03 03:50:30.206257 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User: tempest-DeleteServersTestJSON-1785368639-project Sep 03 03:50:30.206257 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Id: default Sep 03 03:50:30.206257 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Name: Default Sep 03 03:50:30.206257 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Id: a959dec6c0c944aea231b65612892705 Sep 03 03:50:30.206257 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Name: tempest-DeleteServersTestJSON-1785368639-project Sep 03 03:50:30.206257 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: method: > Sep 03 03:50:30.206257 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: exception: Instance e5154156-831e-45fa-b20b-3c6bd4f1f383 could not be found. Sep 03 03:50:30.206257 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: action_args: {'server_id': 'e5154156-831e-45fa-b20b-3c6bd4f1f383'} Sep 03 03:50:30.207026 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:50:30.207026 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:50:30.207026 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 03:50:30.207026 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 03:50:30.207026 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 03:50:30.207026 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 03:50:30.207026 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 03:50:30.207026 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 03:50:30.207026 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 03:50:30.207026 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 03:50:30.207026 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5154156-831e-45fa-b20b-3c6bd4f1f383 could not be found. Sep 03 03:50:30.207026 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:50:30.207026 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:50:30.207026 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:50:30.207026 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:50:30.207026 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:50:30.207026 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:50:30.207026 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:50:30.207026 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:50:30.207026 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:50:30.208174 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:50:30.208174 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 03 03:50:30.208174 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 03:50:30.208174 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 03 03:50:30.208174 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 03:50:30.208174 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 03 03:50:30.208174 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 03 03:50:30.208174 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 03:50:30.208174 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:50:30.208174 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5154156-831e-45fa-b20b-3c6bd4f1f383 could not be found. Sep 03 03:50:30.208174 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:50:30.208174 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:50:30.208174 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:50:30.208174 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:50:30.208174 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:50:30.208174 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:50:30.208174 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:50:30.208174 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:50:30.208174 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5154156-831e-45fa-b20b-3c6bd4f1f383 could not be found. Sep 03 03:50:30.208174 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:50:30.209220 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-b3e37ea6-7c3b-4058-9a1b-38b16c61f7ab tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Returning 404 to user: Instance e5154156-831e-45fa-b20b-3c6bd4f1f383 could not be found. {{(pid=132077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:50:30.209220 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-b3e37ea6-7c3b-4058-9a1b-38b16c61f7ab tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036650 Sep 03 03:50:30.209888 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 128/257] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Sep 3 03:50:30 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383/os-volume_attachments => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 03:50:30.242691 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-5133f061-2203-4e9c-84bf-931bdfb1df2a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:30.243254 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-5133f061-2203-4e9c-84bf-931bdfb1df2a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:30.268964 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5133f061-2203-4e9c-84bf-931bdfb1df2a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:30.269774 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5133f061-2203-4e9c-84bf-931bdfb1df2a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:30.270270 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5133f061-2203-4e9c-84bf-931bdfb1df2a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:30.270568 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5133f061-2203-4e9c-84bf-931bdfb1df2a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:30.271048 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5133f061-2203-4e9c-84bf-931bdfb1df2a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:30.271469 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5133f061-2203-4e9c-84bf-931bdfb1df2a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:30.453608 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-5133f061-2203-4e9c-84bf-931bdfb1df2a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:30.457885 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell1:SELECT=100 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:30.464978 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-5133f061-2203-4e9c-84bf-931bdfb1df2a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1521 microversion: 2.1 time: 0.226169 Sep 03 03:50:30.470469 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-9e4656df-4d84-4e60-8b49-71c9bb9cde0d req-ff874b71-114a-4870-97bd-416eee39570a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4b3eb7f-64e7-4075-b266-a4bbdd04a68a", "name": "network-vif-plugged", "status": "completed", "tag": "58924587-4065-4204-ba33-156d960078cd"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:50:30.475300 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 130/258] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:30 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:30.482423 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-9e4656df-4d84-4e60-8b49-71c9bb9cde0d req-ff874b71-114a-4870-97bd-416eee39570a service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:30.482879 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-9e4656df-4d84-4e60-8b49-71c9bb9cde0d req-ff874b71-114a-4870-97bd-416eee39570a service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:30.483564 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-9e4656df-4d84-4e60-8b49-71c9bb9cde0d req-ff874b71-114a-4870-97bd-416eee39570a service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:30.496191 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-9e4656df-4d84-4e60-8b49-71c9bb9cde0d req-ff874b71-114a-4870-97bd-416eee39570a service nova] Creating event network-vif-plugged:58924587-4065-4204-ba33-156d960078cd for instance e4b3eb7f-64e7-4075-b266-a4bbdd04a68a on hv-cinder-79966 Sep 03 03:50:30.501299 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-9e4656df-4d84-4e60-8b49-71c9bb9cde0d req-ff874b71-114a-4870-97bd-416eee39570a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034303 Sep 03 03:50:30.502340 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 129/259] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:50:31.061624 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-4d437afb-51c5-4ab5-a4c9-692faed6d031 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:31.062369 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-4d437afb-51c5-4ab5-a4c9-692faed6d031 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: e4b3eb7f-64e7-4075-b266-a4bbdd04a68a] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:31.069546 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4d437afb-51c5-4ab5-a4c9-692faed6d031 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:31.070059 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4d437afb-51c5-4ab5-a4c9-692faed6d031 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:31.070734 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4d437afb-51c5-4ab5-a4c9-692faed6d031 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:31.071538 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4d437afb-51c5-4ab5-a4c9-692faed6d031 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:31.072223 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4d437afb-51c5-4ab5-a4c9-692faed6d031 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:31.072923 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4d437afb-51c5-4ab5-a4c9-692faed6d031 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:31.244094 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-4d437afb-51c5-4ab5-a4c9-692faed6d031 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ef1a43f7d445a920e5c4f2b26e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc12b2499eb4f8ab6f3e216b3f6ff3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:31.251886 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-4d437afb-51c5-4ab5-a4c9-692faed6d031 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a" status: 200 len: 1314 microversion: 2.1 time: 0.196276 Sep 03 03:50:31.255266 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 131/260] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:31 2022] GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:31.460428 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-5bce0222-0b51-4e65-8b13-5673026a4d6e tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:31.460999 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-5bce0222-0b51-4e65-8b13-5673026a4d6e tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:31.467441 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5bce0222-0b51-4e65-8b13-5673026a4d6e tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:31.468135 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5bce0222-0b51-4e65-8b13-5673026a4d6e tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:31.468558 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5bce0222-0b51-4e65-8b13-5673026a4d6e tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:31.469244 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5bce0222-0b51-4e65-8b13-5673026a4d6e tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:31.469685 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5bce0222-0b51-4e65-8b13-5673026a4d6e tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:31.470079 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5bce0222-0b51-4e65-8b13-5673026a4d6e tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:31.484063 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.wsgi [None req-5bce0222-0b51-4e65-8b13-5673026a4d6e tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] HTTP exception thrown: Instance e5154156-831e-45fa-b20b-3c6bd4f1f383 could not be found. Sep 03 03:50:31.486188 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-5bce0222-0b51-4e65-8b13-5673026a4d6e tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Request method failure captured: Sep 03 03:50:31.486188 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: request: DELETE /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 HTTP/1.1 Sep 03 03:50:31.486188 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept: application/json Sep 03 03:50:31.486188 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept-Encoding: identity Sep 03 03:50:31.486188 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Connection: close Sep 03 03:50:31.486188 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Length: 0 Sep 03 03:50:31.486188 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Type: application/json Sep 03 03:50:31.486188 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Host: 10.222.0.25 Sep 03 03:50:31.486188 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Openstack-System-Scope: None Sep 03 03:50:31.486188 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: User-Agent: python-urllib3/1.26.12 Sep 03 03:50:31.486188 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Auth-Token: gAAAAABjEs67akeM6yHhm1WPjiUX1l9SeiXrugEK3Ifnt_mzqop8akNxAmVffBLzrmxQY2iNA-jRgt0X5YsgkeXFqz-LH7rasBVmw0pn_EvsCVUB03eUjuQ3J5MygZcyLFBY4NKqFp3mdpY3sYamYFZFz-Clq0jgYbYzVYXfAGuhVdmweR3cRHE Sep 03 03:50:31.486188 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Id: None Sep 03 03:50:31.486188 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Name: None Sep 03 03:50:31.486188 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Identity-Status: Confirmed Sep 03 03:50:31.486188 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Is-Admin-Project: True Sep 03 03:50:31.486188 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Id: default Sep 03 03:50:31.486188 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Name: Default Sep 03 03:50:31.486188 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Id: 968cc9376f884f67b20b91547211fffd Sep 03 03:50:31.486188 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Name: tempest-DeleteServersTestJSON-1785368639 Sep 03 03:50:31.486188 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Role: member,reader Sep 03 03:50:31.486188 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Roles: member,reader Sep 03 03:50:31.487706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/968cc9376f884f67b20b91547211fffd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_968cc9376f884f67b20b91547211fffd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/968cc9376f884f67b20b91547211fffd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/968cc9376f884f67b20b91547211fffd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:50:31.487706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant: tempest-DeleteServersTestJSON-1785368639 Sep 03 03:50:31.487706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Id: 968cc9376f884f67b20b91547211fffd Sep 03 03:50:31.487706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Name: tempest-DeleteServersTestJSON-1785368639 Sep 03 03:50:31.487706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User: tempest-DeleteServersTestJSON-1785368639-project Sep 03 03:50:31.487706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Id: default Sep 03 03:50:31.487706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Name: Default Sep 03 03:50:31.487706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Id: a959dec6c0c944aea231b65612892705 Sep 03 03:50:31.487706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Name: tempest-DeleteServersTestJSON-1785368639-project Sep 03 03:50:31.487706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: method: > Sep 03 03:50:31.487706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: exception: Instance e5154156-831e-45fa-b20b-3c6bd4f1f383 could not be found. Sep 03 03:50:31.487706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: action_args: {'id': 'e5154156-831e-45fa-b20b-3c6bd4f1f383'} Sep 03 03:50:31.488510 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:50:31.488510 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:50:31.488510 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 03:50:31.488510 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 03:50:31.488510 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 03:50:31.488510 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 03:50:31.488510 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 03:50:31.488510 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 03:50:31.488510 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 03:50:31.488510 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 03:50:31.488510 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5154156-831e-45fa-b20b-3c6bd4f1f383 could not be found. Sep 03 03:50:31.488510 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:50:31.488510 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:50:31.488510 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:50:31.488510 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:50:31.488510 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:50:31.488510 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:50:31.488510 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:50:31.488510 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:50:31.488510 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:50:31.489814 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:50:31.489814 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 03:50:31.489814 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 03:50:31.489814 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 03:50:31.489814 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 03:50:31.489814 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 03:50:31.489814 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 03:50:31.489814 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 03:50:31.489814 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:50:31.489814 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5154156-831e-45fa-b20b-3c6bd4f1f383 could not be found. Sep 03 03:50:31.489814 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:50:31.489814 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:50:31.489814 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:50:31.489814 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:50:31.489814 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:50:31.489814 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:50:31.489814 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:50:31.489814 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:50:31.489814 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5154156-831e-45fa-b20b-3c6bd4f1f383 could not be found. Sep 03 03:50:31.489814 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:50:31.491168 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-5bce0222-0b51-4e65-8b13-5673026a4d6e tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Returning 404 to user: Instance e5154156-831e-45fa-b20b-3c6bd4f1f383 could not be found. {{(pid=132077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:50:31.491168 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-5bce0222-0b51-4e65-8b13-5673026a4d6e tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 404 len: 111 microversion: 2.1 time: 0.031613 Sep 03 03:50:31.491168 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 130/261] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Sep 3 03:50:31 2022] DELETE /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 03:50:31.494673 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-0039d6bc-865d-4383-9201-9bdf32bdcb4f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:31.495612 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-0039d6bc-865d-4383-9201-9bdf32bdcb4f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:31.496314 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-6f1c0aba-f63c-4c4b-9dca-ba6bf938aa49 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:31.496916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-6f1c0aba-f63c-4c4b-9dca-ba6bf938aa49 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] [instance: e5154156-831e-45fa-b20b-3c6bd4f1f383] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:31.501879 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0039d6bc-865d-4383-9201-9bdf32bdcb4f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:31.502648 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0039d6bc-865d-4383-9201-9bdf32bdcb4f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:31.503132 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0039d6bc-865d-4383-9201-9bdf32bdcb4f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:31.503426 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6f1c0aba-f63c-4c4b-9dca-ba6bf938aa49 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:31.503823 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0039d6bc-865d-4383-9201-9bdf32bdcb4f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:31.503947 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6f1c0aba-f63c-4c4b-9dca-ba6bf938aa49 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:31.504314 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6f1c0aba-f63c-4c4b-9dca-ba6bf938aa49 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:31.504709 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0039d6bc-865d-4383-9201-9bdf32bdcb4f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:31.504991 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6f1c0aba-f63c-4c4b-9dca-ba6bf938aa49 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:31.505291 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0039d6bc-865d-4383-9201-9bdf32bdcb4f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:31.505436 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6f1c0aba-f63c-4c4b-9dca-ba6bf938aa49 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:31.505846 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6f1c0aba-f63c-4c4b-9dca-ba6bf938aa49 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:31.519792 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.wsgi [None req-6f1c0aba-f63c-4c4b-9dca-ba6bf938aa49 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] HTTP exception thrown: Instance e5154156-831e-45fa-b20b-3c6bd4f1f383 could not be found. Sep 03 03:50:31.521484 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-6f1c0aba-f63c-4c4b-9dca-ba6bf938aa49 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Request method failure captured: Sep 03 03:50:31.521484 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: request: GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 HTTP/1.1 Sep 03 03:50:31.521484 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept: application/json Sep 03 03:50:31.521484 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept-Encoding: identity Sep 03 03:50:31.521484 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Connection: close Sep 03 03:50:31.521484 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Length: 0 Sep 03 03:50:31.521484 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Type: application/json Sep 03 03:50:31.521484 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Host: 10.222.0.25 Sep 03 03:50:31.521484 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Openstack-System-Scope: None Sep 03 03:50:31.521484 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: User-Agent: python-urllib3/1.26.12 Sep 03 03:50:31.521484 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Auth-Token: gAAAAABjEs67akeM6yHhm1WPjiUX1l9SeiXrugEK3Ifnt_mzqop8akNxAmVffBLzrmxQY2iNA-jRgt0X5YsgkeXFqz-LH7rasBVmw0pn_EvsCVUB03eUjuQ3J5MygZcyLFBY4NKqFp3mdpY3sYamYFZFz-Clq0jgYbYzVYXfAGuhVdmweR3cRHE Sep 03 03:50:31.521484 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Id: None Sep 03 03:50:31.521484 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Name: None Sep 03 03:50:31.521484 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Identity-Status: Confirmed Sep 03 03:50:31.521484 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Is-Admin-Project: True Sep 03 03:50:31.521484 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Id: default Sep 03 03:50:31.521484 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Name: Default Sep 03 03:50:31.521484 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Id: 968cc9376f884f67b20b91547211fffd Sep 03 03:50:31.521484 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Name: tempest-DeleteServersTestJSON-1785368639 Sep 03 03:50:31.521484 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Role: member,reader Sep 03 03:50:31.521484 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Roles: member,reader Sep 03 03:50:31.522654 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/968cc9376f884f67b20b91547211fffd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_968cc9376f884f67b20b91547211fffd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/968cc9376f884f67b20b91547211fffd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/968cc9376f884f67b20b91547211fffd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:50:31.522654 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant: tempest-DeleteServersTestJSON-1785368639 Sep 03 03:50:31.522654 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Id: 968cc9376f884f67b20b91547211fffd Sep 03 03:50:31.522654 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Name: tempest-DeleteServersTestJSON-1785368639 Sep 03 03:50:31.522654 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User: tempest-DeleteServersTestJSON-1785368639-project Sep 03 03:50:31.522654 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Id: default Sep 03 03:50:31.522654 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Name: Default Sep 03 03:50:31.522654 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Id: a959dec6c0c944aea231b65612892705 Sep 03 03:50:31.522654 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Name: tempest-DeleteServersTestJSON-1785368639-project Sep 03 03:50:31.522654 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: method: > Sep 03 03:50:31.522654 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: exception: Instance e5154156-831e-45fa-b20b-3c6bd4f1f383 could not be found. Sep 03 03:50:31.522654 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: action_args: {'id': 'e5154156-831e-45fa-b20b-3c6bd4f1f383'} Sep 03 03:50:31.523328 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:50:31.523328 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:50:31.523328 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 03:50:31.523328 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 03:50:31.523328 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 03:50:31.523328 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 03:50:31.523328 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 03:50:31.523328 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 03:50:31.523328 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 03:50:31.523328 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 03:50:31.523328 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5154156-831e-45fa-b20b-3c6bd4f1f383 could not be found. Sep 03 03:50:31.523328 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:50:31.523328 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:50:31.523328 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:50:31.523328 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:50:31.523328 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:50:31.523328 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:50:31.523328 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:50:31.523328 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:50:31.523328 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:50:31.524350 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:50:31.524350 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 03:50:31.524350 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 03:50:31.524350 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 03:50:31.524350 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 03:50:31.524350 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 03:50:31.524350 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:50:31.524350 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5154156-831e-45fa-b20b-3c6bd4f1f383 could not be found. Sep 03 03:50:31.524350 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:50:31.524350 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:50:31.524350 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:50:31.524350 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:50:31.524350 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:50:31.524350 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:50:31.524350 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:50:31.524350 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:50:31.524350 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5154156-831e-45fa-b20b-3c6bd4f1f383 could not be found. Sep 03 03:50:31.524350 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:50:31.525365 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-6f1c0aba-f63c-4c4b-9dca-ba6bf938aa49 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] Returning 404 to user: Instance e5154156-831e-45fa-b20b-3c6bd4f1f383 could not be found. {{(pid=132077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:50:31.525365 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-6f1c0aba-f63c-4c4b-9dca-ba6bf938aa49 tempest-DeleteServersTestJSON-1785368639 tempest-DeleteServersTestJSON-1785368639-project] 10.222.0.25 "GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383" status: 404 len: 111 microversion: 2.1 time: 0.030655 Sep 03 03:50:31.527762 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 131/262] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:31 2022] GET /compute/v2.1/servers/e5154156-831e-45fa-b20b-3c6bd4f1f383 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 03:50:31.639008 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-0039d6bc-865d-4383-9201-9bdf32bdcb4f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:31.647431 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-0039d6bc-865d-4383-9201-9bdf32bdcb4f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1521 microversion: 2.1 time: 0.159904 Sep 03 03:50:31.648212 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 132/263] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:31 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:50:32.281165 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-e55745a7-57db-4de5-8bd1-7bbc4756712b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:32.281764 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-e55745a7-57db-4de5-8bd1-7bbc4756712b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: e4b3eb7f-64e7-4075-b266-a4bbdd04a68a] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:32.288022 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e55745a7-57db-4de5-8bd1-7bbc4756712b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:32.288499 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e55745a7-57db-4de5-8bd1-7bbc4756712b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:32.288924 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e55745a7-57db-4de5-8bd1-7bbc4756712b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:32.289615 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e55745a7-57db-4de5-8bd1-7bbc4756712b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:32.290064 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e55745a7-57db-4de5-8bd1-7bbc4756712b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:32.290477 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e55745a7-57db-4de5-8bd1-7bbc4756712b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:32.581862 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-e55745a7-57db-4de5-8bd1-7bbc4756712b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ef1a43f7d445a920e5c4f2b26e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc12b2499eb4f8ab6f3e216b3f6ff3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:32.596879 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-e55745a7-57db-4de5-8bd1-7bbc4756712b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a" status: 200 len: 1314 microversion: 2.1 time: 0.318653 Sep 03 03:50:32.597792 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 132/264] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:32 2022] GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:32.672193 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-f646a195-1202-41e8-a7b2-e14a6c82fa28 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:32.672788 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-f646a195-1202-41e8-a7b2-e14a6c82fa28 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:32.680197 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f646a195-1202-41e8-a7b2-e14a6c82fa28 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:32.680757 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f646a195-1202-41e8-a7b2-e14a6c82fa28 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:32.681244 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f646a195-1202-41e8-a7b2-e14a6c82fa28 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:32.682237 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f646a195-1202-41e8-a7b2-e14a6c82fa28 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:32.682709 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f646a195-1202-41e8-a7b2-e14a6c82fa28 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:32.684229 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f646a195-1202-41e8-a7b2-e14a6c82fa28 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:32.833659 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-f646a195-1202-41e8-a7b2-e14a6c82fa28 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:32.841695 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-f646a195-1202-41e8-a7b2-e14a6c82fa28 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1521 microversion: 2.1 time: 0.174430 Sep 03 03:50:32.842615 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 133/265] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:32 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:33.631056 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-8dd285ab-afaa-4fb6-aa53-7e4905d0f46e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:33.631779 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-8dd285ab-afaa-4fb6-aa53-7e4905d0f46e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: e4b3eb7f-64e7-4075-b266-a4bbdd04a68a] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:33.647113 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8dd285ab-afaa-4fb6-aa53-7e4905d0f46e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:33.647768 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8dd285ab-afaa-4fb6-aa53-7e4905d0f46e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:33.648352 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8dd285ab-afaa-4fb6-aa53-7e4905d0f46e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:33.649058 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8dd285ab-afaa-4fb6-aa53-7e4905d0f46e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:33.649485 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8dd285ab-afaa-4fb6-aa53-7e4905d0f46e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:33.649892 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8dd285ab-afaa-4fb6-aa53-7e4905d0f46e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:33.866541 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-7546450d-abf7-444c-a6ce-dc51a46dd7ea tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:33.867343 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-7546450d-abf7-444c-a6ce-dc51a46dd7ea tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:33.876267 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7546450d-abf7-444c-a6ce-dc51a46dd7ea tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:33.879381 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7546450d-abf7-444c-a6ce-dc51a46dd7ea tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:33.879941 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7546450d-abf7-444c-a6ce-dc51a46dd7ea tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:33.882120 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7546450d-abf7-444c-a6ce-dc51a46dd7ea tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:33.882832 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7546450d-abf7-444c-a6ce-dc51a46dd7ea tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:33.884596 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7546450d-abf7-444c-a6ce-dc51a46dd7ea tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:33.932985 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-8dd285ab-afaa-4fb6-aa53-7e4905d0f46e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ef1a43f7d445a920e5c4f2b26e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc12b2499eb4f8ab6f3e216b3f6ff3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:33.955277 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-8dd285ab-afaa-4fb6-aa53-7e4905d0f46e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a" status: 200 len: 1497 microversion: 2.1 time: 0.335356 Sep 03 03:50:33.956008 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 133/266] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:33 2022] GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a => generated 1497 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:34.063150 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-7546450d-abf7-444c-a6ce-dc51a46dd7ea tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:34.072906 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-7546450d-abf7-444c-a6ce-dc51a46dd7ea tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1521 microversion: 2.1 time: 0.211376 Sep 03 03:50:34.073490 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 134/267] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:33 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:34.544091 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-92534ecd-6b37-4680-b2e0-f99e98d00a16 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:34.544613 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-92534ecd-6b37-4680-b2e0-f99e98d00a16 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: e4b3eb7f-64e7-4075-b266-a4bbdd04a68a] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:34.551004 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-92534ecd-6b37-4680-b2e0-f99e98d00a16 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:34.551526 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-92534ecd-6b37-4680-b2e0-f99e98d00a16 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:34.552173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-92534ecd-6b37-4680-b2e0-f99e98d00a16 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:34.553046 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-92534ecd-6b37-4680-b2e0-f99e98d00a16 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:34.553664 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-92534ecd-6b37-4680-b2e0-f99e98d00a16 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:34.554084 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-92534ecd-6b37-4680-b2e0-f99e98d00a16 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:34.586838 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-92534ecd-6b37-4680-b2e0-f99e98d00a16 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: e4b3eb7f-64e7-4075-b266-a4bbdd04a68a] Going to try to terminate instance {{(pid=132077) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 03:50:34.700510 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-92534ecd-6b37-4680-b2e0-f99e98d00a16 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a" status: 204 len: 0 microversion: 2.1 time: 0.159944 Sep 03 03:50:34.705543 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 134/268] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Sep 3 03:50:34 2022] DELETE /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 03:50:34.710941 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-683340ab-a883-4f6e-aa0c-cebac45f4a0b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:34.711958 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-683340ab-a883-4f6e-aa0c-cebac45f4a0b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: e4b3eb7f-64e7-4075-b266-a4bbdd04a68a] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:34.719188 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-683340ab-a883-4f6e-aa0c-cebac45f4a0b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:34.719947 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-683340ab-a883-4f6e-aa0c-cebac45f4a0b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:34.720558 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-683340ab-a883-4f6e-aa0c-cebac45f4a0b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:34.721712 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-683340ab-a883-4f6e-aa0c-cebac45f4a0b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:34.722358 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-683340ab-a883-4f6e-aa0c-cebac45f4a0b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:34.723196 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-683340ab-a883-4f6e-aa0c-cebac45f4a0b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:34.927534 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-683340ab-a883-4f6e-aa0c-cebac45f4a0b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ef1a43f7d445a920e5c4f2b26e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc12b2499eb4f8ab6f3e216b3f6ff3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:34.943993 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-683340ab-a883-4f6e-aa0c-cebac45f4a0b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a" status: 200 len: 1503 microversion: 2.1 time: 0.237630 Sep 03 03:50:34.963204 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 135/269] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:34 2022] GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a => generated 1503 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:35.100242 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-a4132c6f-680c-4ce9-b460-95966b6929e4 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:35.100969 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-a4132c6f-680c-4ce9-b460-95966b6929e4 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:35.112157 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a4132c6f-680c-4ce9-b460-95966b6929e4 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:35.112971 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a4132c6f-680c-4ce9-b460-95966b6929e4 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:35.115116 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a4132c6f-680c-4ce9-b460-95966b6929e4 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:35.117162 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a4132c6f-680c-4ce9-b460-95966b6929e4 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:35.117829 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a4132c6f-680c-4ce9-b460-95966b6929e4 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:35.118476 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a4132c6f-680c-4ce9-b460-95966b6929e4 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:35.362163 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a4132c6f-680c-4ce9-b460-95966b6929e4 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:35.373165 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-a4132c6f-680c-4ce9-b460-95966b6929e4 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1521 microversion: 2.1 time: 0.277743 Sep 03 03:50:35.374444 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 135/270] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:35 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:35.970668 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-aeded2f0-7cfc-47b1-9494-976a0ae93e20 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:35.971566 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-aeded2f0-7cfc-47b1-9494-976a0ae93e20 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: e4b3eb7f-64e7-4075-b266-a4bbdd04a68a] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:35.979967 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-aeded2f0-7cfc-47b1-9494-976a0ae93e20 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:35.980978 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-aeded2f0-7cfc-47b1-9494-976a0ae93e20 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:35.982556 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-aeded2f0-7cfc-47b1-9494-976a0ae93e20 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:35.983405 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-aeded2f0-7cfc-47b1-9494-976a0ae93e20 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:35.983883 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-aeded2f0-7cfc-47b1-9494-976a0ae93e20 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:35.984345 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-aeded2f0-7cfc-47b1-9494-976a0ae93e20 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:36.141754 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-aeded2f0-7cfc-47b1-9494-976a0ae93e20 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ef1a43f7d445a920e5c4f2b26e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc12b2499eb4f8ab6f3e216b3f6ff3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:36.153690 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-aeded2f0-7cfc-47b1-9494-976a0ae93e20 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a" status: 200 len: 1503 microversion: 2.1 time: 0.187197 Sep 03 03:50:36.171731 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 136/271] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:35 2022] GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a => generated 1503 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:36.396744 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-10f1197e-1183-49c7-a868-035550a03625 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:36.397194 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-10f1197e-1183-49c7-a868-035550a03625 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:36.404404 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-10f1197e-1183-49c7-a868-035550a03625 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:36.405217 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-10f1197e-1183-49c7-a868-035550a03625 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:36.406263 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-10f1197e-1183-49c7-a868-035550a03625 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:36.407291 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-10f1197e-1183-49c7-a868-035550a03625 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:36.408425 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-10f1197e-1183-49c7-a868-035550a03625 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:36.408838 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-10f1197e-1183-49c7-a868-035550a03625 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:36.591782 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-10f1197e-1183-49c7-a868-035550a03625 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:36.608110 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-10f1197e-1183-49c7-a868-035550a03625 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1521 microversion: 2.1 time: 0.215391 Sep 03 03:50:36.616192 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 136/272] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:36 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:37.183023 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-e0bfdfda-1464-4773-8c3c-cfc5bbd7b3c4 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:37.183615 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-e0bfdfda-1464-4773-8c3c-cfc5bbd7b3c4 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: e4b3eb7f-64e7-4075-b266-a4bbdd04a68a] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:37.190564 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e0bfdfda-1464-4773-8c3c-cfc5bbd7b3c4 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:37.191061 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e0bfdfda-1464-4773-8c3c-cfc5bbd7b3c4 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:37.192087 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e0bfdfda-1464-4773-8c3c-cfc5bbd7b3c4 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:37.192968 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e0bfdfda-1464-4773-8c3c-cfc5bbd7b3c4 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:37.193587 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e0bfdfda-1464-4773-8c3c-cfc5bbd7b3c4 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:37.193994 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e0bfdfda-1464-4773-8c3c-cfc5bbd7b3c4 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:37.347614 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-e0bfdfda-1464-4773-8c3c-cfc5bbd7b3c4 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ef1a43f7d445a920e5c4f2b26e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc12b2499eb4f8ab6f3e216b3f6ff3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:37.356222 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-e0bfdfda-1464-4773-8c3c-cfc5bbd7b3c4 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a" status: 200 len: 1503 microversion: 2.1 time: 0.177247 Sep 03 03:50:37.368822 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 137/273] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:37 2022] GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a => generated 1503 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:37.638648 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-9ea221a3-f970-428b-a97f-8b5c3fe57542 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:37.639369 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-9ea221a3-f970-428b-a97f-8b5c3fe57542 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:37.647188 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9ea221a3-f970-428b-a97f-8b5c3fe57542 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:37.647188 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9ea221a3-f970-428b-a97f-8b5c3fe57542 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:37.647188 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9ea221a3-f970-428b-a97f-8b5c3fe57542 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:37.647607 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9ea221a3-f970-428b-a97f-8b5c3fe57542 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:37.648114 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9ea221a3-f970-428b-a97f-8b5c3fe57542 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:37.648513 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9ea221a3-f970-428b-a97f-8b5c3fe57542 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:37.805597 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-9ea221a3-f970-428b-a97f-8b5c3fe57542 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:37.814121 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-9ea221a3-f970-428b-a97f-8b5c3fe57542 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1501 microversion: 2.1 time: 0.180309 Sep 03 03:50:37.814929 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 137/274] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:37 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1501 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:37.836051 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-cb56e222-9829-4e82-bd7c-c5ce6f77bfac tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:37.836649 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-cb56e222-9829-4e82-bd7c-c5ce6f77bfac tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: f7f92467-64ec-4eba-af52-ad4923543504] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:37.842472 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cb56e222-9829-4e82-bd7c-c5ce6f77bfac tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:37.842985 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cb56e222-9829-4e82-bd7c-c5ce6f77bfac tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:37.843412 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cb56e222-9829-4e82-bd7c-c5ce6f77bfac tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:37.844085 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cb56e222-9829-4e82-bd7c-c5ce6f77bfac tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:37.844523 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cb56e222-9829-4e82-bd7c-c5ce6f77bfac tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:37.844933 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cb56e222-9829-4e82-bd7c-c5ce6f77bfac tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:37.991777 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-cb56e222-9829-4e82-bd7c-c5ce6f77bfac tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:37.999532 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-cb56e222-9829-4e82-bd7c-c5ce6f77bfac tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504" status: 200 len: 1516 microversion: 2.1 time: 0.167325 Sep 03 03:50:38.000105 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 138/275] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:37 2022] GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504 => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:38.380866 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-e0bf1ecf-8b4d-4ec3-89db-5b0424e8eec8 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:38.381471 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-e0bf1ecf-8b4d-4ec3-89db-5b0424e8eec8 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: e4b3eb7f-64e7-4075-b266-a4bbdd04a68a] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:38.388074 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e0bf1ecf-8b4d-4ec3-89db-5b0424e8eec8 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:38.388445 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e0bf1ecf-8b4d-4ec3-89db-5b0424e8eec8 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:38.388881 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e0bf1ecf-8b4d-4ec3-89db-5b0424e8eec8 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:38.389574 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e0bf1ecf-8b4d-4ec3-89db-5b0424e8eec8 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:38.390031 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e0bf1ecf-8b4d-4ec3-89db-5b0424e8eec8 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:38.390451 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e0bf1ecf-8b4d-4ec3-89db-5b0424e8eec8 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:38.537875 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-e0bf1ecf-8b4d-4ec3-89db-5b0424e8eec8 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ef1a43f7d445a920e5c4f2b26e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc12b2499eb4f8ab6f3e216b3f6ff3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:38.545768 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-e0bf1ecf-8b4d-4ec3-89db-5b0424e8eec8 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a" status: 200 len: 1503 microversion: 2.1 time: 0.169152 Sep 03 03:50:38.546413 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 138/276] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:38 2022] GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:39.569553 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-d73caa30-a85c-4b0f-b298-492c5c222828 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:39.570087 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-d73caa30-a85c-4b0f-b298-492c5c222828 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: e4b3eb7f-64e7-4075-b266-a4bbdd04a68a] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:39.576536 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d73caa30-a85c-4b0f-b298-492c5c222828 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:39.577012 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d73caa30-a85c-4b0f-b298-492c5c222828 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:39.577562 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d73caa30-a85c-4b0f-b298-492c5c222828 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:39.578244 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d73caa30-a85c-4b0f-b298-492c5c222828 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:39.578732 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d73caa30-a85c-4b0f-b298-492c5c222828 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:39.579281 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d73caa30-a85c-4b0f-b298-492c5c222828 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:39.716379 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-d73caa30-a85c-4b0f-b298-492c5c222828 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ef1a43f7d445a920e5c4f2b26e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc12b2499eb4f8ab6f3e216b3f6ff3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:39.724429 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-d73caa30-a85c-4b0f-b298-492c5c222828 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a" status: 200 len: 1503 microversion: 2.1 time: 0.158776 Sep 03 03:50:39.724996 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 139/277] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:39 2022] GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:50:40.364855 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-f6f4cb2f-2206-4d66-a5c8-ce3f40c529eb req-213cb5b9-1f9c-4807-892b-f210d5e7e061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4b3eb7f-64e7-4075-b266-a4bbdd04a68a", "name": "network-vif-unplugged", "status": "completed", "tag": "58924587-4065-4204-ba33-156d960078cd"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:50:40.386153 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-f6f4cb2f-2206-4d66-a5c8-ce3f40c529eb req-213cb5b9-1f9c-4807-892b-f210d5e7e061 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:40.386765 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-f6f4cb2f-2206-4d66-a5c8-ce3f40c529eb req-213cb5b9-1f9c-4807-892b-f210d5e7e061 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:40.387457 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-f6f4cb2f-2206-4d66-a5c8-ce3f40c529eb req-213cb5b9-1f9c-4807-892b-f210d5e7e061 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:40.401001 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-f6f4cb2f-2206-4d66-a5c8-ce3f40c529eb req-213cb5b9-1f9c-4807-892b-f210d5e7e061 service nova] Creating event network-vif-unplugged:58924587-4065-4204-ba33-156d960078cd for instance e4b3eb7f-64e7-4075-b266-a4bbdd04a68a on hv-cinder-79966 Sep 03 03:50:40.406896 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-f6f4cb2f-2206-4d66-a5c8-ce3f40c529eb req-213cb5b9-1f9c-4807-892b-f210d5e7e061 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055083 Sep 03 03:50:40.408061 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 139/278] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 03:50:40.554292 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-4b01477f-ba2f-4863-8cc1-b410bde2b19a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:50:40.559226 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-4b01477f-ba2f-4863-8cc1-b410bde2b19a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: f7f92467-64ec-4eba-af52-ad4923543504] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:40.566788 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4b01477f-ba2f-4863-8cc1-b410bde2b19a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:40.567278 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4b01477f-ba2f-4863-8cc1-b410bde2b19a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:40.567697 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4b01477f-ba2f-4863-8cc1-b410bde2b19a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:40.568545 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4b01477f-ba2f-4863-8cc1-b410bde2b19a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:40.569133 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4b01477f-ba2f-4863-8cc1-b410bde2b19a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:40.569692 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4b01477f-ba2f-4863-8cc1-b410bde2b19a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:40.599048 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.objects.instance [None req-4b01477f-ba2f-4863-8cc1-b410bde2b19a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lazy-loading 'flavor' on Instance uuid f7f92467-64ec-4eba-af52-ad4923543504 {{(pid=132076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 03:50:40.640086 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-15b2d62f-a814-442d-b3ed-2e665e10fe95 req-5b82efb5-7ce5-4951-9725-588d839ca014 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4b3eb7f-64e7-4075-b266-a4bbdd04a68a", "name": "network-vif-deleted", "tag": "58924587-4065-4204-ba33-156d960078cd"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:50:40.655226 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-15b2d62f-a814-442d-b3ed-2e665e10fe95 req-5b82efb5-7ce5-4951-9725-588d839ca014 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:40.655691 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-15b2d62f-a814-442d-b3ed-2e665e10fe95 req-5b82efb5-7ce5-4951-9725-588d839ca014 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:40.656116 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-15b2d62f-a814-442d-b3ed-2e665e10fe95 req-5b82efb5-7ce5-4951-9725-588d839ca014 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:40.667901 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-15b2d62f-a814-442d-b3ed-2e665e10fe95 req-5b82efb5-7ce5-4951-9725-588d839ca014 service nova] Creating event network-vif-deleted:58924587-4065-4204-ba33-156d960078cd for instance e4b3eb7f-64e7-4075-b266-a4bbdd04a68a on hv-cinder-79966 Sep 03 03:50:40.672726 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-15b2d62f-a814-442d-b3ed-2e665e10fe95 req-5b82efb5-7ce5-4951-9725-588d839ca014 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048933 Sep 03 03:50:40.673669 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 140/279] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:50:40.748769 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-4b01477f-ba2f-4863-8cc1-b410bde2b19a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "POST /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504/action" status: 200 len: 32 microversion: 2.1 time: 0.198505 Sep 03 03:50:40.749410 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 140/280] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Sep 3 03:50:40 2022] POST /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504/action => generated 32 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 03 03:50:40.749637 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-34b6acf7-8f67-4e8b-a647-b99f68e4bede tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:40.754452 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-34b6acf7-8f67-4e8b-a647-b99f68e4bede tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: e4b3eb7f-64e7-4075-b266-a4bbdd04a68a] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:40.761062 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-34b6acf7-8f67-4e8b-a647-b99f68e4bede tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:40.761683 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-34b6acf7-8f67-4e8b-a647-b99f68e4bede tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:40.762121 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-34b6acf7-8f67-4e8b-a647-b99f68e4bede tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:40.762961 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-34b6acf7-8f67-4e8b-a647-b99f68e4bede tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:40.763416 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-34b6acf7-8f67-4e8b-a647-b99f68e4bede tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:40.763827 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-34b6acf7-8f67-4e8b-a647-b99f68e4bede tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:40.764943 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-f12b598e-effe-433a-9d93-9a4c3a551983 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:40.766687 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-f12b598e-effe-433a-9d93-9a4c3a551983 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: f7f92467-64ec-4eba-af52-ad4923543504] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:40.795796 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f12b598e-effe-433a-9d93-9a4c3a551983 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:40.797065 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f12b598e-effe-433a-9d93-9a4c3a551983 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:40.797771 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f12b598e-effe-433a-9d93-9a4c3a551983 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:40.800078 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f12b598e-effe-433a-9d93-9a4c3a551983 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:40.802233 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f12b598e-effe-433a-9d93-9a4c3a551983 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:40.802789 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f12b598e-effe-433a-9d93-9a4c3a551983 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:40.808489 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-34b6acf7-8f67-4e8b-a647-b99f68e4bede tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:40.809552 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-34b6acf7-8f67-4e8b-a647-b99f68e4bede tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:40.811551 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-34b6acf7-8f67-4e8b-a647-b99f68e4bede tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:40.812249 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.objects.instance [None req-34b6acf7-8f67-4e8b-a647-b99f68e4bede tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lazy-loading 'fault' on Instance uuid e4b3eb7f-64e7-4075-b266-a4bbdd04a68a {{(pid=132077) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 03:50:40.886203 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-34b6acf7-8f67-4e8b-a647-b99f68e4bede tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ef1a43f7d445a920e5c4f2b26e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc12b2499eb4f8ab6f3e216b3f6ff3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:40.900315 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-34b6acf7-8f67-4e8b-a647-b99f68e4bede tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a" status: 200 len: 1304 microversion: 2.1 time: 0.156557 Sep 03 03:50:40.917135 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 141/281] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:40 2022] GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a => generated 1304 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:41.124833 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-f12b598e-effe-433a-9d93-9a4c3a551983 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:41.134951 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-f12b598e-effe-433a-9d93-9a4c3a551983 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504" status: 200 len: 1522 microversion: 2.1 time: 0.378957 Sep 03 03:50:41.138366 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 141/282] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:40 2022] GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504 => generated 1522 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:41.925140 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-a932981f-d3cd-4445-9a83-b1263d8350cd tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:41.925775 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-a932981f-d3cd-4445-9a83-b1263d8350cd tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: e4b3eb7f-64e7-4075-b266-a4bbdd04a68a] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:41.932857 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a932981f-d3cd-4445-9a83-b1263d8350cd tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:41.933521 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a932981f-d3cd-4445-9a83-b1263d8350cd tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:41.933961 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a932981f-d3cd-4445-9a83-b1263d8350cd tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:41.934658 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a932981f-d3cd-4445-9a83-b1263d8350cd tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:41.935411 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a932981f-d3cd-4445-9a83-b1263d8350cd tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:41.935876 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a932981f-d3cd-4445-9a83-b1263d8350cd tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:41.951530 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.wsgi [None req-a932981f-d3cd-4445-9a83-b1263d8350cd tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] HTTP exception thrown: Instance e4b3eb7f-64e7-4075-b266-a4bbdd04a68a could not be found. Sep 03 03:50:41.953226 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-a932981f-d3cd-4445-9a83-b1263d8350cd tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Request method failure captured: Sep 03 03:50:41.953226 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: request: GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a HTTP/1.1 Sep 03 03:50:41.953226 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept: application/json Sep 03 03:50:41.953226 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept-Encoding: identity Sep 03 03:50:41.953226 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Connection: close Sep 03 03:50:41.953226 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Length: 0 Sep 03 03:50:41.953226 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Type: application/json Sep 03 03:50:41.953226 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Host: 10.222.0.25 Sep 03 03:50:41.953226 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Openstack-System-Scope: None Sep 03 03:50:41.953226 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: User-Agent: python-urllib3/1.26.12 Sep 03 03:50:41.953226 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Auth-Token: gAAAAABjEs7xk4wlSpTMiVXNtijm4aDfxuOWBz60_kosNoNPVXfwC4OAb6YLtZTssADJeKwWQk179_JSIRR3TATfd_pWnm3CBPJjKKav91ugFyHl-fRz_sOzc_i4qGUIG38oLOE5mrq24GYVTAAtAvIfL_TKPirYCfCYkBB519mWb_f_bhOqNIo Sep 03 03:50:41.953226 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Id: None Sep 03 03:50:41.953226 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Name: None Sep 03 03:50:41.953226 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Identity-Status: Confirmed Sep 03 03:50:41.953226 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Is-Admin-Project: True Sep 03 03:50:41.953226 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Id: default Sep 03 03:50:41.953226 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Name: Default Sep 03 03:50:41.953226 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Id: 8dc12b2499eb4f8ab6f3e216b3f6ff3e Sep 03 03:50:41.953226 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Name: tempest-VolumesActionsTest-1337461497 Sep 03 03:50:41.953226 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Role: member,reader Sep 03 03:50:41.953226 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Roles: member,reader Sep 03 03:50:41.954704 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8dc12b2499eb4f8ab6f3e216b3f6ff3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8dc12b2499eb4f8ab6f3e216b3f6ff3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8dc12b2499eb4f8ab6f3e216b3f6ff3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8dc12b2499eb4f8ab6f3e216b3f6ff3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:50:41.954704 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant: tempest-VolumesActionsTest-1337461497 Sep 03 03:50:41.954704 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Id: 8dc12b2499eb4f8ab6f3e216b3f6ff3e Sep 03 03:50:41.954704 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Name: tempest-VolumesActionsTest-1337461497 Sep 03 03:50:41.954704 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User: tempest-VolumesActionsTest-1337461497-project Sep 03 03:50:41.954704 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Id: default Sep 03 03:50:41.954704 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Name: Default Sep 03 03:50:41.954704 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Id: 658ef1a43f7d445a920e5c4f2b26e339 Sep 03 03:50:41.954704 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Name: tempest-VolumesActionsTest-1337461497-project Sep 03 03:50:41.954704 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: method: > Sep 03 03:50:41.954704 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: exception: Instance e4b3eb7f-64e7-4075-b266-a4bbdd04a68a could not be found. Sep 03 03:50:41.954704 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: action_args: {'id': 'e4b3eb7f-64e7-4075-b266-a4bbdd04a68a'} Sep 03 03:50:41.955771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:50:41.955771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:50:41.955771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 03:50:41.955771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 03:50:41.955771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 03:50:41.955771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 03:50:41.955771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 03:50:41.955771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 03:50:41.955771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 03:50:41.955771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 03:50:41.955771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4b3eb7f-64e7-4075-b266-a4bbdd04a68a could not be found. Sep 03 03:50:41.955771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:50:41.955771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:50:41.955771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:50:41.955771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:50:41.955771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:50:41.955771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:50:41.955771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:50:41.955771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:50:41.955771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:50:41.957083 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:50:41.957083 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 03:50:41.957083 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 03:50:41.957083 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 03:50:41.957083 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 03:50:41.957083 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 03:50:41.957083 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:50:41.957083 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4b3eb7f-64e7-4075-b266-a4bbdd04a68a could not be found. Sep 03 03:50:41.957083 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:50:41.957083 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:50:41.957083 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:50:41.957083 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:50:41.957083 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:50:41.957083 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:50:41.957083 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:50:41.957083 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:50:41.957083 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4b3eb7f-64e7-4075-b266-a4bbdd04a68a could not be found. Sep 03 03:50:41.957083 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:50:41.958232 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-a932981f-d3cd-4445-9a83-b1263d8350cd tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Returning 404 to user: Instance e4b3eb7f-64e7-4075-b266-a4bbdd04a68a could not be found. {{(pid=132077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:50:41.958232 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-a932981f-d3cd-4445-9a83-b1263d8350cd tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a" status: 404 len: 111 microversion: 2.1 time: 0.034295 Sep 03 03:50:41.967372 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 142/283] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:41 2022] GET /compute/v2.1/servers/e4b3eb7f-64e7-4075-b266-a4bbdd04a68a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 03:50:42.069817 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-bbb35fd8-153f-4ffa-82dd-571e517c587e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-924687539", "imageRef": "0af209bb-870a-4343-a9f9-de05883bb8dd", "flavorRef": "452", "networks": [{"uuid": "6bcb1a0b-8951-44fc-bce8-a3327924fd60"}]}} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:50:42.133447 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.network.neutron [None req-bbb35fd8-153f-4ffa-82dd-571e517c587e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] validate_networks() for [('6bcb1a0b-8951-44fc-bce8-a3327924fd60', None, None, None, None, None)] {{(pid=132076) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 03:50:42.161471 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-8471eba5-267b-4d67-be8d-94ea7527494a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:42.162075 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-8471eba5-267b-4d67-be8d-94ea7527494a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: f7f92467-64ec-4eba-af52-ad4923543504] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:42.168326 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8471eba5-267b-4d67-be8d-94ea7527494a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:42.168998 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8471eba5-267b-4d67-be8d-94ea7527494a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:42.169422 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8471eba5-267b-4d67-be8d-94ea7527494a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:42.170396 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8471eba5-267b-4d67-be8d-94ea7527494a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:42.171019 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8471eba5-267b-4d67-be8d-94ea7527494a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:42.171583 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8471eba5-267b-4d67-be8d-94ea7527494a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:42.332859 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-8471eba5-267b-4d67-be8d-94ea7527494a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:42.341992 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-8471eba5-267b-4d67-be8d-94ea7527494a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504" status: 200 len: 1522 microversion: 2.1 time: 0.185787 Sep 03 03:50:42.342849 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 143/284] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:42 2022] GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:42.502300 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-bbb35fd8-153f-4ffa-82dd-571e517c587e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Flavor limits 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 03:50:42.502718 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-bbb35fd8-153f-4ffa-82dd-571e517c587e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Image limits 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 03:50:42.503258 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-bbb35fd8-153f-4ffa-82dd-571e517c587e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Flavor pref 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 03:50:42.503666 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-bbb35fd8-153f-4ffa-82dd-571e517c587e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Image pref 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 03:50:42.504067 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-bbb35fd8-153f-4ffa-82dd-571e517c587e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 03:50:42.512785 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-bbb35fd8-153f-4ffa-82dd-571e517c587e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:42.513258 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-bbb35fd8-153f-4ffa-82dd-571e517c587e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:42.513679 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-bbb35fd8-153f-4ffa-82dd-571e517c587e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:42.514394 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-bbb35fd8-153f-4ffa-82dd-571e517c587e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:42.514860 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-bbb35fd8-153f-4ffa-82dd-571e517c587e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:42.515282 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-bbb35fd8-153f-4ffa-82dd-571e517c587e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:42.531622 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.quota [None req-bbb35fd8-153f-4ffa-82dd-571e517c587e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Getting quotas for project 8dc12b2499eb4f8ab6f3e216b3f6ff3e. Resources: {'ram', 'instances', 'cores'} {{(pid=132076) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 03:50:42.535624 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.quota [None req-bbb35fd8-153f-4ffa-82dd-571e517c587e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Getting quotas for user 658ef1a43f7d445a920e5c4f2b26e339 and project 8dc12b2499eb4f8ab6f3e216b3f6ff3e. Resources: {'ram', 'instances', 'cores'} {{(pid=132076) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 03:50:42.546398 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-bbb35fd8-153f-4ffa-82dd-571e517c587e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Going to run 1 instances... {{(pid=132076) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 03:50:42.548746 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-bbb35fd8-153f-4ffa-82dd-571e517c587e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: c400550e-6713-43de-90e7-82d00c2b2cfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0af209bb-870a-4343-a9f9-de05883bb8dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132076) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 03:50:42.596616 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-bbb35fd8-153f-4ffa-82dd-571e517c587e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.530530 Sep 03 03:50:42.597862 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 142/285] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Sep 3 03:50:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 03:50:42.609462 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-bd0db764-b3a3-46fd-bd27-8b93eefe7fd8 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:42.610069 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-bd0db764-b3a3-46fd-bd27-8b93eefe7fd8 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: c400550e-6713-43de-90e7-82d00c2b2cfa] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:42.701007 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-bd0db764-b3a3-46fd-bd27-8b93eefe7fd8 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ef1a43f7d445a920e5c4f2b26e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc12b2499eb4f8ab6f3e216b3f6ff3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:42.710552 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-bd0db764-b3a3-46fd-bd27-8b93eefe7fd8 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "GET /compute/v2.1/servers/c400550e-6713-43de-90e7-82d00c2b2cfa" status: 200 len: 1213 microversion: 2.1 time: 0.105167 Sep 03 03:50:42.711485 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 144/286] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:42 2022] GET /compute/v2.1/servers/c400550e-6713-43de-90e7-82d00c2b2cfa => generated 1213 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:43.366003 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-00942226-dd39-41b0-b585-b09442a020df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:43.366737 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-00942226-dd39-41b0-b585-b09442a020df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: f7f92467-64ec-4eba-af52-ad4923543504] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:43.377431 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-00942226-dd39-41b0-b585-b09442a020df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:43.377926 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-00942226-dd39-41b0-b585-b09442a020df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:43.378381 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-00942226-dd39-41b0-b585-b09442a020df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:43.379163 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-00942226-dd39-41b0-b585-b09442a020df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:43.379549 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-00942226-dd39-41b0-b585-b09442a020df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:43.379974 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-00942226-dd39-41b0-b585-b09442a020df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:43.684615 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-00942226-dd39-41b0-b585-b09442a020df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:43.692647 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-00942226-dd39-41b0-b585-b09442a020df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504" status: 200 len: 1522 microversion: 2.1 time: 0.330811 Sep 03 03:50:43.693216 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 143/287] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:43 2022] GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504 => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:43.735674 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-93f3f30c-9637-4bce-828e-0034828e99ab tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:43.736388 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-93f3f30c-9637-4bce-828e-0034828e99ab tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: c400550e-6713-43de-90e7-82d00c2b2cfa] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:43.742331 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-93f3f30c-9637-4bce-828e-0034828e99ab tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:43.742829 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-93f3f30c-9637-4bce-828e-0034828e99ab tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:43.743258 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-93f3f30c-9637-4bce-828e-0034828e99ab tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:43.743944 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-93f3f30c-9637-4bce-828e-0034828e99ab tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:43.744395 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-93f3f30c-9637-4bce-828e-0034828e99ab tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:43.744806 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-93f3f30c-9637-4bce-828e-0034828e99ab tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:43.807928 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-93f3f30c-9637-4bce-828e-0034828e99ab tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ef1a43f7d445a920e5c4f2b26e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc12b2499eb4f8ab6f3e216b3f6ff3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:43.815505 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-93f3f30c-9637-4bce-828e-0034828e99ab tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "GET /compute/v2.1/servers/c400550e-6713-43de-90e7-82d00c2b2cfa" status: 200 len: 1265 microversion: 2.1 time: 0.083958 Sep 03 03:50:43.816064 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 145/288] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:43 2022] GET /compute/v2.1/servers/c400550e-6713-43de-90e7-82d00c2b2cfa => generated 1265 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:44.717929 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-6d51b332-6a59-45f5-a00e-b10d9b1e2ab1 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:44.718768 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-6d51b332-6a59-45f5-a00e-b10d9b1e2ab1 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: f7f92467-64ec-4eba-af52-ad4923543504] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:44.731324 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6d51b332-6a59-45f5-a00e-b10d9b1e2ab1 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:44.732634 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6d51b332-6a59-45f5-a00e-b10d9b1e2ab1 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:44.733238 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6d51b332-6a59-45f5-a00e-b10d9b1e2ab1 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:44.734384 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6d51b332-6a59-45f5-a00e-b10d9b1e2ab1 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:44.734943 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6d51b332-6a59-45f5-a00e-b10d9b1e2ab1 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:44.735745 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6d51b332-6a59-45f5-a00e-b10d9b1e2ab1 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:44.838037 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-430c075b-1361-41f7-9cac-3dcd6d53b41a tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:44.838713 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-430c075b-1361-41f7-9cac-3dcd6d53b41a tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: c400550e-6713-43de-90e7-82d00c2b2cfa] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:44.846405 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-430c075b-1361-41f7-9cac-3dcd6d53b41a tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:44.847345 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-430c075b-1361-41f7-9cac-3dcd6d53b41a tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:44.847925 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-430c075b-1361-41f7-9cac-3dcd6d53b41a tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:44.848741 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-430c075b-1361-41f7-9cac-3dcd6d53b41a tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:44.849182 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-430c075b-1361-41f7-9cac-3dcd6d53b41a tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:44.849591 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-430c075b-1361-41f7-9cac-3dcd6d53b41a tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:45.041603 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-430c075b-1361-41f7-9cac-3dcd6d53b41a tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ef1a43f7d445a920e5c4f2b26e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc12b2499eb4f8ab6f3e216b3f6ff3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:45.042291 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-6d51b332-6a59-45f5-a00e-b10d9b1e2ab1 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:45.050413 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-6d51b332-6a59-45f5-a00e-b10d9b1e2ab1 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504" status: 200 len: 1522 microversion: 2.1 time: 0.337300 Sep 03 03:50:45.054949 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 144/289] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:44 2022] GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504 => generated 1522 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:45.069453 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-430c075b-1361-41f7-9cac-3dcd6d53b41a tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "GET /compute/v2.1/servers/c400550e-6713-43de-90e7-82d00c2b2cfa" status: 200 len: 1313 microversion: 2.1 time: 0.235416 Sep 03 03:50:45.084656 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 146/290] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:44 2022] GET /compute/v2.1/servers/c400550e-6713-43de-90e7-82d00c2b2cfa => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:45.503483 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-e1c33fc2-cffd-49fa-a528-97b2e959c07a req-be02317c-1afa-4d52-b7cf-204cb4104d95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c400550e-6713-43de-90e7-82d00c2b2cfa", "tag": "1cb03196-5878-4940-a083-2e60315b04f4"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:50:45.514166 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-e1c33fc2-cffd-49fa-a528-97b2e959c07a req-be02317c-1afa-4d52-b7cf-204cb4104d95 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:45.514920 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-e1c33fc2-cffd-49fa-a528-97b2e959c07a req-be02317c-1afa-4d52-b7cf-204cb4104d95 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:45.515511 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-e1c33fc2-cffd-49fa-a528-97b2e959c07a req-be02317c-1afa-4d52-b7cf-204cb4104d95 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:45.527867 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-e1c33fc2-cffd-49fa-a528-97b2e959c07a req-be02317c-1afa-4d52-b7cf-204cb4104d95 service nova] Creating event network-changed:1cb03196-5878-4940-a083-2e60315b04f4 for instance c400550e-6713-43de-90e7-82d00c2b2cfa on hv-cinder-79966 Sep 03 03:50:45.534556 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-e1c33fc2-cffd-49fa-a528-97b2e959c07a req-be02317c-1afa-4d52-b7cf-204cb4104d95 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034858 Sep 03 03:50:45.535413 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 145/291] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:50:46.076521 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-4fd21fba-c798-4255-a665-ee0edb1140cd tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:46.077173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-4fd21fba-c798-4255-a665-ee0edb1140cd tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: f7f92467-64ec-4eba-af52-ad4923543504] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:46.083182 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4fd21fba-c798-4255-a665-ee0edb1140cd tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:46.083666 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4fd21fba-c798-4255-a665-ee0edb1140cd tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:46.084117 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4fd21fba-c798-4255-a665-ee0edb1140cd tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:46.084803 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4fd21fba-c798-4255-a665-ee0edb1140cd tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:46.085248 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4fd21fba-c798-4255-a665-ee0edb1140cd tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:46.085672 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4fd21fba-c798-4255-a665-ee0edb1140cd tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:46.105419 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:46.108715 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-588b70a3-6d15-4d90-b72f-823ca74db00b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:46.109496 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-588b70a3-6d15-4d90-b72f-823ca74db00b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: c400550e-6713-43de-90e7-82d00c2b2cfa] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:46.116435 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-588b70a3-6d15-4d90-b72f-823ca74db00b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:46.117064 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-588b70a3-6d15-4d90-b72f-823ca74db00b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:46.117583 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-588b70a3-6d15-4d90-b72f-823ca74db00b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:46.128967 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-588b70a3-6d15-4d90-b72f-823ca74db00b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:46.129447 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-588b70a3-6d15-4d90-b72f-823ca74db00b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:46.129881 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-588b70a3-6d15-4d90-b72f-823ca74db00b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:46.229685 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-4fd21fba-c798-4255-a665-ee0edb1140cd tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:46.238037 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-4fd21fba-c798-4255-a665-ee0edb1140cd tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504" status: 200 len: 1522 microversion: 2.1 time: 0.165297 Sep 03 03:50:46.239066 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 147/292] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:46 2022] GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:46.281837 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-588b70a3-6d15-4d90-b72f-823ca74db00b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ef1a43f7d445a920e5c4f2b26e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc12b2499eb4f8ab6f3e216b3f6ff3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:46.285492 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:46.291450 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-588b70a3-6d15-4d90-b72f-823ca74db00b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "GET /compute/v2.1/servers/c400550e-6713-43de-90e7-82d00c2b2cfa" status: 200 len: 1313 microversion: 2.1 time: 0.187985 Sep 03 03:50:46.292019 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 146/293] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:46 2022] GET /compute/v2.1/servers/c400550e-6713-43de-90e7-82d00c2b2cfa => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:47.262535 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-67d2cb7d-137d-401b-abcd-eb03b7f4df7f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:47.263168 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-67d2cb7d-137d-401b-abcd-eb03b7f4df7f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: f7f92467-64ec-4eba-af52-ad4923543504] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:47.269307 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-67d2cb7d-137d-401b-abcd-eb03b7f4df7f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:47.269792 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-67d2cb7d-137d-401b-abcd-eb03b7f4df7f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:47.270218 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-67d2cb7d-137d-401b-abcd-eb03b7f4df7f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:47.270940 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-67d2cb7d-137d-401b-abcd-eb03b7f4df7f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:47.271390 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-67d2cb7d-137d-401b-abcd-eb03b7f4df7f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:47.271894 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-67d2cb7d-137d-401b-abcd-eb03b7f4df7f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:47.314783 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-b472bb94-f038-46f2-96bf-a7c4b9bcdf06 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:47.315605 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-b472bb94-f038-46f2-96bf-a7c4b9bcdf06 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: c400550e-6713-43de-90e7-82d00c2b2cfa] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:47.323707 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b472bb94-f038-46f2-96bf-a7c4b9bcdf06 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:47.324212 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b472bb94-f038-46f2-96bf-a7c4b9bcdf06 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:47.324632 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b472bb94-f038-46f2-96bf-a7c4b9bcdf06 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:47.325381 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b472bb94-f038-46f2-96bf-a7c4b9bcdf06 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:47.325822 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b472bb94-f038-46f2-96bf-a7c4b9bcdf06 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:47.326215 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b472bb94-f038-46f2-96bf-a7c4b9bcdf06 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:47.414391 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-67d2cb7d-137d-401b-abcd-eb03b7f4df7f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:47.422675 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-67d2cb7d-137d-401b-abcd-eb03b7f4df7f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504" status: 200 len: 1522 microversion: 2.1 time: 0.164413 Sep 03 03:50:47.423401 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 148/294] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:47 2022] GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:47.778938 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-b472bb94-f038-46f2-96bf-a7c4b9bcdf06 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ef1a43f7d445a920e5c4f2b26e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc12b2499eb4f8ab6f3e216b3f6ff3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:47.787206 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-b472bb94-f038-46f2-96bf-a7c4b9bcdf06 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "GET /compute/v2.1/servers/c400550e-6713-43de-90e7-82d00c2b2cfa" status: 200 len: 1313 microversion: 2.1 time: 0.476520 Sep 03 03:50:47.787772 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 147/295] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:47 2022] GET /compute/v2.1/servers/c400550e-6713-43de-90e7-82d00c2b2cfa => generated 1313 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:50:48.447572 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-a3a5233a-d946-463f-b99d-beecbd179ba0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:48.448805 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-a3a5233a-d946-463f-b99d-beecbd179ba0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: f7f92467-64ec-4eba-af52-ad4923543504] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:48.455666 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a3a5233a-d946-463f-b99d-beecbd179ba0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:48.456546 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a3a5233a-d946-463f-b99d-beecbd179ba0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:48.457118 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a3a5233a-d946-463f-b99d-beecbd179ba0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:48.457958 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a3a5233a-d946-463f-b99d-beecbd179ba0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:48.458541 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a3a5233a-d946-463f-b99d-beecbd179ba0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:48.459675 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a3a5233a-d946-463f-b99d-beecbd179ba0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:48.652249 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a3a5233a-d946-463f-b99d-beecbd179ba0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:48.660940 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-a3a5233a-d946-463f-b99d-beecbd179ba0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504" status: 200 len: 1522 microversion: 2.1 time: 0.217293 Sep 03 03:50:48.661559 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 149/296] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:48 2022] GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:48.811932 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-f7940294-5f0a-4639-bc45-fb51bd3ceaba tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:48.812763 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-f7940294-5f0a-4639-bc45-fb51bd3ceaba tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: c400550e-6713-43de-90e7-82d00c2b2cfa] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:48.820430 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f7940294-5f0a-4639-bc45-fb51bd3ceaba tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:48.821495 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f7940294-5f0a-4639-bc45-fb51bd3ceaba tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:48.822300 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f7940294-5f0a-4639-bc45-fb51bd3ceaba tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:48.823531 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f7940294-5f0a-4639-bc45-fb51bd3ceaba tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:48.824192 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f7940294-5f0a-4639-bc45-fb51bd3ceaba tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:48.824901 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f7940294-5f0a-4639-bc45-fb51bd3ceaba tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:48.976084 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-f7940294-5f0a-4639-bc45-fb51bd3ceaba tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ef1a43f7d445a920e5c4f2b26e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc12b2499eb4f8ab6f3e216b3f6ff3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:48.986463 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-f7940294-5f0a-4639-bc45-fb51bd3ceaba tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "GET /compute/v2.1/servers/c400550e-6713-43de-90e7-82d00c2b2cfa" status: 200 len: 1313 microversion: 2.1 time: 0.178967 Sep 03 03:50:48.987401 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 148/297] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:48 2022] GET /compute/v2.1/servers/c400550e-6713-43de-90e7-82d00c2b2cfa => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:49.684582 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-a7347003-3139-49af-b272-d17816c0eb11 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:49.685239 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-a7347003-3139-49af-b272-d17816c0eb11 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: f7f92467-64ec-4eba-af52-ad4923543504] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:49.692635 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a7347003-3139-49af-b272-d17816c0eb11 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:49.695140 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a7347003-3139-49af-b272-d17816c0eb11 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:49.695671 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a7347003-3139-49af-b272-d17816c0eb11 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:49.696461 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a7347003-3139-49af-b272-d17816c0eb11 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:49.696977 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a7347003-3139-49af-b272-d17816c0eb11 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:49.697476 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a7347003-3139-49af-b272-d17816c0eb11 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:49.844786 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a7347003-3139-49af-b272-d17816c0eb11 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:49.853790 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-a7347003-3139-49af-b272-d17816c0eb11 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504" status: 200 len: 1522 microversion: 2.1 time: 0.173109 Sep 03 03:50:49.854851 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 150/298] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:49 2022] GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:50.009993 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-180a4677-3d04-48b0-8e89-77e542a86a29 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:50.010644 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-180a4677-3d04-48b0-8e89-77e542a86a29 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: c400550e-6713-43de-90e7-82d00c2b2cfa] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:50.017335 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-180a4677-3d04-48b0-8e89-77e542a86a29 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:50.017814 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-180a4677-3d04-48b0-8e89-77e542a86a29 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:50.018243 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-180a4677-3d04-48b0-8e89-77e542a86a29 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:50.018985 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-180a4677-3d04-48b0-8e89-77e542a86a29 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:50.019421 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-180a4677-3d04-48b0-8e89-77e542a86a29 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:50.019831 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-180a4677-3d04-48b0-8e89-77e542a86a29 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:50.173208 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-180a4677-3d04-48b0-8e89-77e542a86a29 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ef1a43f7d445a920e5c4f2b26e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc12b2499eb4f8ab6f3e216b3f6ff3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:50.181325 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-180a4677-3d04-48b0-8e89-77e542a86a29 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "GET /compute/v2.1/servers/c400550e-6713-43de-90e7-82d00c2b2cfa" status: 200 len: 1313 microversion: 2.1 time: 0.175203 Sep 03 03:50:50.181880 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 149/299] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:50 2022] GET /compute/v2.1/servers/c400550e-6713-43de-90e7-82d00c2b2cfa => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:50.442095 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-6ead7d99-0a41-4d9d-bce1-397fb913c634 req-7fe0364b-0831-46e6-92cc-02d3a69b0058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c400550e-6713-43de-90e7-82d00c2b2cfa", "name": "network-vif-plugged", "status": "completed", "tag": "1cb03196-5878-4940-a083-2e60315b04f4"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:50:50.452265 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-6ead7d99-0a41-4d9d-bce1-397fb913c634 req-7fe0364b-0831-46e6-92cc-02d3a69b0058 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:50.452750 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-6ead7d99-0a41-4d9d-bce1-397fb913c634 req-7fe0364b-0831-46e6-92cc-02d3a69b0058 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:50.453180 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-6ead7d99-0a41-4d9d-bce1-397fb913c634 req-7fe0364b-0831-46e6-92cc-02d3a69b0058 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:50.464513 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-6ead7d99-0a41-4d9d-bce1-397fb913c634 req-7fe0364b-0831-46e6-92cc-02d3a69b0058 service nova] Creating event network-vif-plugged:1cb03196-5878-4940-a083-2e60315b04f4 for instance c400550e-6713-43de-90e7-82d00c2b2cfa on hv-cinder-79966 Sep 03 03:50:50.469391 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-6ead7d99-0a41-4d9d-bce1-397fb913c634 req-7fe0364b-0831-46e6-92cc-02d3a69b0058 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031222 Sep 03 03:50:50.469963 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 151/300] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:50:50.878717 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-2b2903c5-96a3-4064-a9a6-6b81731ae881 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:50.879351 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-2b2903c5-96a3-4064-a9a6-6b81731ae881 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: f7f92467-64ec-4eba-af52-ad4923543504] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:50.886269 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2b2903c5-96a3-4064-a9a6-6b81731ae881 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:50.886751 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2b2903c5-96a3-4064-a9a6-6b81731ae881 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:50.887215 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2b2903c5-96a3-4064-a9a6-6b81731ae881 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:50.887904 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2b2903c5-96a3-4064-a9a6-6b81731ae881 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:50.888352 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2b2903c5-96a3-4064-a9a6-6b81731ae881 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:50.888776 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2b2903c5-96a3-4064-a9a6-6b81731ae881 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:51.036385 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-2b2903c5-96a3-4064-a9a6-6b81731ae881 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:51.044895 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-2b2903c5-96a3-4064-a9a6-6b81731ae881 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504" status: 200 len: 1522 microversion: 2.1 time: 0.170221 Sep 03 03:50:51.045459 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 150/301] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:50 2022] GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:51.207426 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-6671524f-ed4f-411e-95a0-9ef0e4845be9 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:51.208155 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-6671524f-ed4f-411e-95a0-9ef0e4845be9 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: c400550e-6713-43de-90e7-82d00c2b2cfa] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:51.214439 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6671524f-ed4f-411e-95a0-9ef0e4845be9 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:51.214967 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6671524f-ed4f-411e-95a0-9ef0e4845be9 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:51.215432 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6671524f-ed4f-411e-95a0-9ef0e4845be9 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:51.216119 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6671524f-ed4f-411e-95a0-9ef0e4845be9 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:51.216565 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6671524f-ed4f-411e-95a0-9ef0e4845be9 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:51.216980 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6671524f-ed4f-411e-95a0-9ef0e4845be9 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:51.350161 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-6671524f-ed4f-411e-95a0-9ef0e4845be9 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ef1a43f7d445a920e5c4f2b26e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc12b2499eb4f8ab6f3e216b3f6ff3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:51.358384 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-6671524f-ed4f-411e-95a0-9ef0e4845be9 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "GET /compute/v2.1/servers/c400550e-6713-43de-90e7-82d00c2b2cfa" status: 200 len: 1313 microversion: 2.1 time: 0.156644 Sep 03 03:50:51.358970 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 152/302] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:51 2022] GET /compute/v2.1/servers/c400550e-6713-43de-90e7-82d00c2b2cfa => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:52.068114 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-ef0fa212-d774-428d-a003-d87db5211c18 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:52.068671 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-ef0fa212-d774-428d-a003-d87db5211c18 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: f7f92467-64ec-4eba-af52-ad4923543504] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:52.075260 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ef0fa212-d774-428d-a003-d87db5211c18 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:52.075733 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ef0fa212-d774-428d-a003-d87db5211c18 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:52.076155 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ef0fa212-d774-428d-a003-d87db5211c18 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:52.076831 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ef0fa212-d774-428d-a003-d87db5211c18 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:52.077279 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ef0fa212-d774-428d-a003-d87db5211c18 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:52.077735 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ef0fa212-d774-428d-a003-d87db5211c18 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:52.220096 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-ef0fa212-d774-428d-a003-d87db5211c18 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:52.227843 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-ef0fa212-d774-428d-a003-d87db5211c18 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504" status: 200 len: 1522 microversion: 2.1 time: 0.163945 Sep 03 03:50:52.228393 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 151/303] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:52 2022] GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:52.381461 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-cb0ec587-e690-4ef6-879a-6ba897fdbb50 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:52.382016 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-cb0ec587-e690-4ef6-879a-6ba897fdbb50 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: c400550e-6713-43de-90e7-82d00c2b2cfa] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:52.388415 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cb0ec587-e690-4ef6-879a-6ba897fdbb50 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:52.388898 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cb0ec587-e690-4ef6-879a-6ba897fdbb50 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:52.389325 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cb0ec587-e690-4ef6-879a-6ba897fdbb50 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:52.390038 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cb0ec587-e690-4ef6-879a-6ba897fdbb50 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:52.390484 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cb0ec587-e690-4ef6-879a-6ba897fdbb50 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:52.390940 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cb0ec587-e690-4ef6-879a-6ba897fdbb50 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:52.526374 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-cb0ec587-e690-4ef6-879a-6ba897fdbb50 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ef1a43f7d445a920e5c4f2b26e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc12b2499eb4f8ab6f3e216b3f6ff3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:52.535165 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-cb0ec587-e690-4ef6-879a-6ba897fdbb50 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "GET /compute/v2.1/servers/c400550e-6713-43de-90e7-82d00c2b2cfa" status: 200 len: 1313 microversion: 2.1 time: 0.157441 Sep 03 03:50:52.535742 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 153/304] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:52 2022] GET /compute/v2.1/servers/c400550e-6713-43de-90e7-82d00c2b2cfa => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:53.256055 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-af0dc715-c91b-4bf4-8d76-fa507ed407bc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:53.256607 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-af0dc715-c91b-4bf4-8d76-fa507ed407bc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: f7f92467-64ec-4eba-af52-ad4923543504] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:53.259450 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell0:SELECT=2 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:53.260047 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell0:SELECT=6 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:53.264401 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-af0dc715-c91b-4bf4-8d76-fa507ed407bc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:53.264873 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-af0dc715-c91b-4bf4-8d76-fa507ed407bc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:53.265294 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-af0dc715-c91b-4bf4-8d76-fa507ed407bc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:53.265978 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-af0dc715-c91b-4bf4-8d76-fa507ed407bc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:53.266418 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-af0dc715-c91b-4bf4-8d76-fa507ed407bc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:53.266836 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-af0dc715-c91b-4bf4-8d76-fa507ed407bc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:53.401066 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-af0dc715-c91b-4bf4-8d76-fa507ed407bc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:53.410101 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-af0dc715-c91b-4bf4-8d76-fa507ed407bc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504" status: 200 len: 1522 microversion: 2.1 time: 0.157914 Sep 03 03:50:53.410750 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 152/305] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:53 2022] GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:53.557445 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-046102a4-5996-485d-8b86-d99a41186c5e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:53.558041 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-046102a4-5996-485d-8b86-d99a41186c5e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: c400550e-6713-43de-90e7-82d00c2b2cfa] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:53.560051 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell0:SELECT=2 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:53.565250 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-046102a4-5996-485d-8b86-d99a41186c5e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:53.565728 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-046102a4-5996-485d-8b86-d99a41186c5e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:53.566153 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-046102a4-5996-485d-8b86-d99a41186c5e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:53.566849 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-046102a4-5996-485d-8b86-d99a41186c5e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:53.567291 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-046102a4-5996-485d-8b86-d99a41186c5e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:53.567846 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-046102a4-5996-485d-8b86-d99a41186c5e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:53.841385 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-046102a4-5996-485d-8b86-d99a41186c5e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ef1a43f7d445a920e5c4f2b26e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc12b2499eb4f8ab6f3e216b3f6ff3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:53.849851 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-046102a4-5996-485d-8b86-d99a41186c5e tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "GET /compute/v2.1/servers/c400550e-6713-43de-90e7-82d00c2b2cfa" status: 200 len: 1497 microversion: 2.1 time: 0.296114 Sep 03 03:50:53.850732 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 154/306] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:53 2022] GET /compute/v2.1/servers/c400550e-6713-43de-90e7-82d00c2b2cfa => generated 1497 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:54.405124 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-41106ae2-1531-46a6-9c17-abe6b521260b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:54.406677 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-41106ae2-1531-46a6-9c17-abe6b521260b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: c400550e-6713-43de-90e7-82d00c2b2cfa] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:54.414015 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-41106ae2-1531-46a6-9c17-abe6b521260b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:54.414491 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-41106ae2-1531-46a6-9c17-abe6b521260b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:54.415412 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-41106ae2-1531-46a6-9c17-abe6b521260b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:54.416403 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-41106ae2-1531-46a6-9c17-abe6b521260b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:54.416878 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-41106ae2-1531-46a6-9c17-abe6b521260b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:54.417541 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-41106ae2-1531-46a6-9c17-abe6b521260b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:54.433867 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-90088184-e26f-46bb-bcfe-81a6815f0e18 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:54.434581 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-90088184-e26f-46bb-bcfe-81a6815f0e18 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: f7f92467-64ec-4eba-af52-ad4923543504] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:54.440788 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-90088184-e26f-46bb-bcfe-81a6815f0e18 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:54.441701 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-90088184-e26f-46bb-bcfe-81a6815f0e18 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:54.442408 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-90088184-e26f-46bb-bcfe-81a6815f0e18 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:54.443367 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-90088184-e26f-46bb-bcfe-81a6815f0e18 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:54.444029 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-90088184-e26f-46bb-bcfe-81a6815f0e18 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:54.444748 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-90088184-e26f-46bb-bcfe-81a6815f0e18 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:54.445795 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-41106ae2-1531-46a6-9c17-abe6b521260b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: c400550e-6713-43de-90e7-82d00c2b2cfa] Going to try to terminate instance {{(pid=132076) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 03:50:54.540366 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-41106ae2-1531-46a6-9c17-abe6b521260b tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c400550e-6713-43de-90e7-82d00c2b2cfa" status: 204 len: 0 microversion: 2.1 time: 0.140066 Sep 03 03:50:54.541164 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 153/307] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Sep 3 03:50:54 2022] DELETE /compute/v2.1/servers/c400550e-6713-43de-90e7-82d00c2b2cfa => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 03:50:54.549601 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-c09aa094-5767-44fd-97a4-9f4f067a2c98 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:54.550347 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-c09aa094-5767-44fd-97a4-9f4f067a2c98 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: c400550e-6713-43de-90e7-82d00c2b2cfa] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:54.556103 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c09aa094-5767-44fd-97a4-9f4f067a2c98 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:54.556580 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c09aa094-5767-44fd-97a4-9f4f067a2c98 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:54.557000 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c09aa094-5767-44fd-97a4-9f4f067a2c98 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:54.557680 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c09aa094-5767-44fd-97a4-9f4f067a2c98 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:54.558118 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c09aa094-5767-44fd-97a4-9f4f067a2c98 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:54.558605 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c09aa094-5767-44fd-97a4-9f4f067a2c98 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:54.623846 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-90088184-e26f-46bb-bcfe-81a6815f0e18 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:54.636937 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-90088184-e26f-46bb-bcfe-81a6815f0e18 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504" status: 200 len: 1522 microversion: 2.1 time: 0.206738 Sep 03 03:50:54.638122 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 155/308] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:54 2022] GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:54.725721 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-c09aa094-5767-44fd-97a4-9f4f067a2c98 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ef1a43f7d445a920e5c4f2b26e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc12b2499eb4f8ab6f3e216b3f6ff3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:54.736005 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-c09aa094-5767-44fd-97a4-9f4f067a2c98 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "GET /compute/v2.1/servers/c400550e-6713-43de-90e7-82d00c2b2cfa" status: 200 len: 1503 microversion: 2.1 time: 0.190473 Sep 03 03:50:54.747406 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 154/309] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:54 2022] GET /compute/v2.1/servers/c400550e-6713-43de-90e7-82d00c2b2cfa => generated 1503 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:55.661816 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-0ce29724-9a7d-4462-a733-dfebb70c7592 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:55.662596 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-0ce29724-9a7d-4462-a733-dfebb70c7592 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: f7f92467-64ec-4eba-af52-ad4923543504] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:55.670966 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0ce29724-9a7d-4462-a733-dfebb70c7592 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:55.671577 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0ce29724-9a7d-4462-a733-dfebb70c7592 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:55.672049 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0ce29724-9a7d-4462-a733-dfebb70c7592 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:55.673181 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0ce29724-9a7d-4462-a733-dfebb70c7592 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:55.673796 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0ce29724-9a7d-4462-a733-dfebb70c7592 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:55.674211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0ce29724-9a7d-4462-a733-dfebb70c7592 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:55.771291 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-0cb74095-f10a-4f74-bc65-9f8bc13fd2b4 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:55.771730 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-0cb74095-f10a-4f74-bc65-9f8bc13fd2b4 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: c400550e-6713-43de-90e7-82d00c2b2cfa] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:55.779895 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0cb74095-f10a-4f74-bc65-9f8bc13fd2b4 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:55.780670 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0cb74095-f10a-4f74-bc65-9f8bc13fd2b4 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:55.781151 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0cb74095-f10a-4f74-bc65-9f8bc13fd2b4 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:55.782052 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0cb74095-f10a-4f74-bc65-9f8bc13fd2b4 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:55.782484 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0cb74095-f10a-4f74-bc65-9f8bc13fd2b4 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:55.782937 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0cb74095-f10a-4f74-bc65-9f8bc13fd2b4 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:55.824133 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-0ce29724-9a7d-4462-a733-dfebb70c7592 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:55.833520 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-0ce29724-9a7d-4462-a733-dfebb70c7592 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504" status: 200 len: 1522 microversion: 2.1 time: 0.177284 Sep 03 03:50:55.846831 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 156/310] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:55 2022] GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:55.927047 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-0cb74095-f10a-4f74-bc65-9f8bc13fd2b4 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ef1a43f7d445a920e5c4f2b26e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc12b2499eb4f8ab6f3e216b3f6ff3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:55.936265 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-0cb74095-f10a-4f74-bc65-9f8bc13fd2b4 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "GET /compute/v2.1/servers/c400550e-6713-43de-90e7-82d00c2b2cfa" status: 200 len: 1503 microversion: 2.1 time: 0.175391 Sep 03 03:50:55.936853 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 155/311] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:55 2022] GET /compute/v2.1/servers/c400550e-6713-43de-90e7-82d00c2b2cfa => generated 1503 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:56.857996 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-ae6b83e7-2e0d-4e55-bff0-39fe178298df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:56.858596 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-ae6b83e7-2e0d-4e55-bff0-39fe178298df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: f7f92467-64ec-4eba-af52-ad4923543504] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:56.875164 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ae6b83e7-2e0d-4e55-bff0-39fe178298df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:56.875639 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ae6b83e7-2e0d-4e55-bff0-39fe178298df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:56.876060 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ae6b83e7-2e0d-4e55-bff0-39fe178298df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:56.876803 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ae6b83e7-2e0d-4e55-bff0-39fe178298df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:56.877246 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ae6b83e7-2e0d-4e55-bff0-39fe178298df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:56.877655 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ae6b83e7-2e0d-4e55-bff0-39fe178298df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:56.958204 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-31bd6dd7-73ce-47ca-a0da-8fdfac7fd0f4 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:56.959551 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-31bd6dd7-73ce-47ca-a0da-8fdfac7fd0f4 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: c400550e-6713-43de-90e7-82d00c2b2cfa] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:56.966983 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-31bd6dd7-73ce-47ca-a0da-8fdfac7fd0f4 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:56.967717 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-31bd6dd7-73ce-47ca-a0da-8fdfac7fd0f4 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:56.968359 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-31bd6dd7-73ce-47ca-a0da-8fdfac7fd0f4 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:56.969254 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-31bd6dd7-73ce-47ca-a0da-8fdfac7fd0f4 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:56.969897 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-31bd6dd7-73ce-47ca-a0da-8fdfac7fd0f4 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:56.970634 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-31bd6dd7-73ce-47ca-a0da-8fdfac7fd0f4 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:57.034760 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-ae6b83e7-2e0d-4e55-bff0-39fe178298df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:57.043378 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-ae6b83e7-2e0d-4e55-bff0-39fe178298df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504" status: 200 len: 1522 microversion: 2.1 time: 0.189617 Sep 03 03:50:57.044174 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 157/312] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:56 2022] GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:57.212520 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-31bd6dd7-73ce-47ca-a0da-8fdfac7fd0f4 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ef1a43f7d445a920e5c4f2b26e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc12b2499eb4f8ab6f3e216b3f6ff3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:57.230903 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-31bd6dd7-73ce-47ca-a0da-8fdfac7fd0f4 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "GET /compute/v2.1/servers/c400550e-6713-43de-90e7-82d00c2b2cfa" status: 200 len: 1503 microversion: 2.1 time: 0.276391 Sep 03 03:50:57.234084 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 156/313] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:56 2022] GET /compute/v2.1/servers/c400550e-6713-43de-90e7-82d00c2b2cfa => generated 1503 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:50:57.489605 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-cf3180ff-f943-40dd-a98b-64be900c59da req-ca1b4bb6-09eb-467d-96ed-d4ff228bec60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c400550e-6713-43de-90e7-82d00c2b2cfa", "name": "network-vif-deleted", "tag": "1cb03196-5878-4940-a083-2e60315b04f4"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:50:57.494762 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:57.501044 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-cf3180ff-f943-40dd-a98b-64be900c59da req-ca1b4bb6-09eb-467d-96ed-d4ff228bec60 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:57.501650 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-cf3180ff-f943-40dd-a98b-64be900c59da req-ca1b4bb6-09eb-467d-96ed-d4ff228bec60 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:57.502207 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-cf3180ff-f943-40dd-a98b-64be900c59da req-ca1b4bb6-09eb-467d-96ed-d4ff228bec60 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:57.514061 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-cf3180ff-f943-40dd-a98b-64be900c59da req-ca1b4bb6-09eb-467d-96ed-d4ff228bec60 service nova] Creating event network-vif-deleted:1cb03196-5878-4940-a083-2e60315b04f4 for instance c400550e-6713-43de-90e7-82d00c2b2cfa on hv-cinder-79966 Sep 03 03:50:57.519047 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-cf3180ff-f943-40dd-a98b-64be900c59da req-ca1b4bb6-09eb-467d-96ed-d4ff228bec60 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033096 Sep 03 03:50:57.519643 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 158/314] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:50:57.900784 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-0e06a410-a237-4265-a519-18de0ba826b5 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:57.901354 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-0e06a410-a237-4265-a519-18de0ba826b5 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:57.921238 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0e06a410-a237-4265-a519-18de0ba826b5 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:57.922249 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0e06a410-a237-4265-a519-18de0ba826b5 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:57.923043 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0e06a410-a237-4265-a519-18de0ba826b5 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:57.924173 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0e06a410-a237-4265-a519-18de0ba826b5 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:57.925015 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0e06a410-a237-4265-a519-18de0ba826b5 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:57.925870 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0e06a410-a237-4265-a519-18de0ba826b5 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:57.960496 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-0e06a410-a237-4265-a519-18de0ba826b5 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911/ips" status: 200 len: 149 microversion: 2.1 time: 0.064788 Sep 03 03:50:57.968550 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 157/315] 10.222.0.25 () {58 vars in 1248 bytes} [Sat Sep 3 03:50:57 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911/ips => generated 149 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:50:58.069128 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-28ca903b-7cac-477d-a2eb-cb61f69ff418 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:58.071176 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-28ca903b-7cac-477d-a2eb-cb61f69ff418 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: f7f92467-64ec-4eba-af52-ad4923543504] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:58.085644 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-28ca903b-7cac-477d-a2eb-cb61f69ff418 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:58.086964 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-28ca903b-7cac-477d-a2eb-cb61f69ff418 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:58.087410 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-28ca903b-7cac-477d-a2eb-cb61f69ff418 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:58.089221 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-28ca903b-7cac-477d-a2eb-cb61f69ff418 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:58.089715 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-28ca903b-7cac-477d-a2eb-cb61f69ff418 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:58.090197 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-28ca903b-7cac-477d-a2eb-cb61f69ff418 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:58.256603 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-a5d94c81-568c-42d4-976b-dac6c8407eca tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:58.257530 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-a5d94c81-568c-42d4-976b-dac6c8407eca tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: c400550e-6713-43de-90e7-82d00c2b2cfa] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:58.266407 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a5d94c81-568c-42d4-976b-dac6c8407eca tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:58.267247 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a5d94c81-568c-42d4-976b-dac6c8407eca tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:58.268396 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a5d94c81-568c-42d4-976b-dac6c8407eca tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:58.269389 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a5d94c81-568c-42d4-976b-dac6c8407eca tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:58.269981 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a5d94c81-568c-42d4-976b-dac6c8407eca tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:58.270642 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a5d94c81-568c-42d4-976b-dac6c8407eca tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:58.315030 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-28ca903b-7cac-477d-a2eb-cb61f69ff418 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:58.316695 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a5d94c81-568c-42d4-976b-dac6c8407eca tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:58.317397 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a5d94c81-568c-42d4-976b-dac6c8407eca tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:58.318063 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a5d94c81-568c-42d4-976b-dac6c8407eca tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:58.318688 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.objects.instance [None req-a5d94c81-568c-42d4-976b-dac6c8407eca tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lazy-loading 'fault' on Instance uuid c400550e-6713-43de-90e7-82d00c2b2cfa {{(pid=132076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 03:50:58.335879 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-28ca903b-7cac-477d-a2eb-cb61f69ff418 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504" status: 200 len: 1502 microversion: 2.1 time: 0.265231 Sep 03 03:50:58.339693 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 159/316] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:58 2022] GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504 => generated 1502 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:50:58.363200 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-c38ce7d6-091c-4fcd-bcfd-b8a2a6297bc7 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65f1d090-df85-4fd3-889d-8ad62591f49d"}} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:50:58.368146 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-c38ce7d6-091c-4fcd-bcfd-b8a2a6297bc7 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: f7f92467-64ec-4eba-af52-ad4923543504] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:58.374762 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c38ce7d6-091c-4fcd-bcfd-b8a2a6297bc7 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:58.375796 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c38ce7d6-091c-4fcd-bcfd-b8a2a6297bc7 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:58.376699 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c38ce7d6-091c-4fcd-bcfd-b8a2a6297bc7 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:58.377690 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c38ce7d6-091c-4fcd-bcfd-b8a2a6297bc7 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:58.378950 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c38ce7d6-091c-4fcd-bcfd-b8a2a6297bc7 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:58.379510 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c38ce7d6-091c-4fcd-bcfd-b8a2a6297bc7 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:58.396006 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-a5d94c81-568c-42d4-976b-dac6c8407eca tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658ef1a43f7d445a920e5c4f2b26e339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc12b2499eb4f8ab6f3e216b3f6ff3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:58.404342 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-a5d94c81-568c-42d4-976b-dac6c8407eca tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "GET /compute/v2.1/servers/c400550e-6713-43de-90e7-82d00c2b2cfa" status: 200 len: 1303 microversion: 2.1 time: 0.151957 Sep 03 03:50:58.418411 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 158/317] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:58 2022] GET /compute/v2.1/servers/c400550e-6713-43de-90e7-82d00c2b2cfa => generated 1303 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:50:58.431492 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.wsgi [None req-c38ce7d6-091c-4fcd-bcfd-b8a2a6297bc7 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] HTTP exception thrown: Cannot 'attach_volume' instance f7f92467-64ec-4eba-af52-ad4923543504 while it is in vm_state rescued Sep 03 03:50:58.433706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-c38ce7d6-091c-4fcd-bcfd-b8a2a6297bc7 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Request method failure captured: Sep 03 03:50:58.433706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: request: POST /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504/os-volume_attachments HTTP/1.1 Sep 03 03:50:58.433706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept: application/json Sep 03 03:50:58.433706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept-Encoding: identity Sep 03 03:50:58.433706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Connection: close Sep 03 03:50:58.433706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Length: 74 Sep 03 03:50:58.433706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Type: application/json Sep 03 03:50:58.433706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Host: 10.222.0.25 Sep 03 03:50:58.433706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Openstack-System-Scope: None Sep 03 03:50:58.433706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: User-Agent: python-urllib3/1.26.12 Sep 03 03:50:58.433706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Auth-Token: gAAAAABjEs66Kx8eeteMVyS4cMyfSkiyDGt_1eVtJar0jOqp2U5kldUKx2JCGXQO7DqE-XDheXtg2VZJo07feGC0TW1g6g8FkP9CZLuHpBInyfHfnQ4XyPTBmpEjfujwrAu0nW2aGLx5J777qnmGLgujnVhLN2AJ7Ilf6ZAuow1eLdAaB6k8vVw Sep 03 03:50:58.433706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Id: None Sep 03 03:50:58.433706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Name: None Sep 03 03:50:58.433706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Identity-Status: Confirmed Sep 03 03:50:58.433706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Is-Admin-Project: True Sep 03 03:50:58.433706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Id: default Sep 03 03:50:58.433706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Name: Default Sep 03 03:50:58.433706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Id: f3077cfc588042e0a1becefe1363385c Sep 03 03:50:58.433706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1521748712 Sep 03 03:50:58.433706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Role: member,reader Sep 03 03:50:58.433706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Roles: member,reader Sep 03 03:50:58.435366 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f3077cfc588042e0a1becefe1363385c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f3077cfc588042e0a1becefe1363385c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f3077cfc588042e0a1becefe1363385c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f3077cfc588042e0a1becefe1363385c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:50:58.435366 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1521748712 Sep 03 03:50:58.435366 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Id: f3077cfc588042e0a1becefe1363385c Sep 03 03:50:58.435366 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1521748712 Sep 03 03:50:58.435366 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User: tempest-ServerRescueNegativeTestJSON-1521748712-project Sep 03 03:50:58.435366 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Id: default Sep 03 03:50:58.435366 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Name: Default Sep 03 03:50:58.435366 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Id: ba00478a6ef74115b83726083026f574 Sep 03 03:50:58.435366 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1521748712-project Sep 03 03:50:58.435366 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Sep 03 03:50:58.435366 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: {"volumeAttachment": {"volumeId": "65f1d090-df85-4fd3-889d-8ad62591f49d"}} Sep 03 03:50:58.435366 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: method: > Sep 03 03:50:58.436212 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: exception: Cannot 'attach_volume' instance f7f92467-64ec-4eba-af52-ad4923543504 while it is in vm_state rescued Sep 03 03:50:58.436212 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: action_args: {'server_id': 'f7f92467-64ec-4eba-af52-ad4923543504', 'body': {'volumeAttachment': {'volumeId': '65f1d090-df85-4fd3-889d-8ad62591f49d'}}} Sep 03 03:50:58.436212 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:50:58.436212 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:50:58.436212 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 03 03:50:58.436212 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 03 03:50:58.436212 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 03 03:50:58.436212 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 03 03:50:58.436212 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 03 03:50:58.436212 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 03 03:50:58.436212 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f7f92467-64ec-4eba-af52-ad4923543504 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 03 03:50:58.436212 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:50:58.436212 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:50:58.436212 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:50:58.436212 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:50:58.436212 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:50:58.436212 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:50:58.436212 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:50:58.436212 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:50:58.437348 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:50:58.437348 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:50:58.437348 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 03:50:58.437348 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 03:50:58.437348 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 03:50:58.437348 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 03:50:58.437348 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 03:50:58.437348 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 03:50:58.437348 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 03 03:50:58.437348 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 03 03:50:58.437348 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 03 03:50:58.437348 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 03 03:50:58.437348 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f7f92467-64ec-4eba-af52-ad4923543504 while it is in vm_state rescued Sep 03 03:50:58.437348 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:50:58.437348 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:50:58.437348 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:50:58.437348 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:50:58.437348 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:50:58.437348 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:50:58.438524 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:50:58.438524 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:50:58.438524 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f7f92467-64ec-4eba-af52-ad4923543504 while it is in vm_state rescued Sep 03 03:50:58.438524 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:50:58.438524 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-c38ce7d6-091c-4fcd-bcfd-b8a2a6297bc7 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Returning 409 to user: Cannot 'attach_volume' instance f7f92467-64ec-4eba-af52-ad4923543504 while it is in vm_state rescued {{(pid=132077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:50:58.438524 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-c38ce7d6-091c-4fcd-bcfd-b8a2a6297bc7 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "POST /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.078308 Sep 03 03:50:58.438524 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 160/318] 10.222.0.25 () {60 vars in 1323 bytes} [Sat Sep 3 03:50:58 2022] POST /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504/os-volume_attachments => generated 152 bytes in 80 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 03 03:50:58.447748 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-1da482ae-8c5f-45ab-8542-31e398b36eb6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:50:58.448398 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-1da482ae-8c5f-45ab-8542-31e398b36eb6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: f7f92467-64ec-4eba-af52-ad4923543504] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:58.470103 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1da482ae-8c5f-45ab-8542-31e398b36eb6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:58.470658 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1da482ae-8c5f-45ab-8542-31e398b36eb6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:58.471120 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1da482ae-8c5f-45ab-8542-31e398b36eb6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:58.471824 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1da482ae-8c5f-45ab-8542-31e398b36eb6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:58.472272 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1da482ae-8c5f-45ab-8542-31e398b36eb6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:58.472690 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1da482ae-8c5f-45ab-8542-31e398b36eb6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:58.550470 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-1da482ae-8c5f-45ab-8542-31e398b36eb6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "POST /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504/action" status: 202 len: 0 microversion: 2.1 time: 0.107414 Sep 03 03:50:58.554386 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 159/319] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Sep 3 03:50:58 2022] POST /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 03 03:50:58.560575 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-816b5136-b83c-499a-aa64-5d6c17fa7bc9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:58.561234 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-816b5136-b83c-499a-aa64-5d6c17fa7bc9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: f7f92467-64ec-4eba-af52-ad4923543504] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:58.570404 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-816b5136-b83c-499a-aa64-5d6c17fa7bc9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:58.570913 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-816b5136-b83c-499a-aa64-5d6c17fa7bc9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:58.571490 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-816b5136-b83c-499a-aa64-5d6c17fa7bc9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:58.572513 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-816b5136-b83c-499a-aa64-5d6c17fa7bc9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:58.573056 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-816b5136-b83c-499a-aa64-5d6c17fa7bc9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:58.573766 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-816b5136-b83c-499a-aa64-5d6c17fa7bc9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:58.709929 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-816b5136-b83c-499a-aa64-5d6c17fa7bc9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:50:58.717792 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-816b5136-b83c-499a-aa64-5d6c17fa7bc9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504" status: 200 len: 1510 microversion: 2.1 time: 0.162408 Sep 03 03:50:58.718312 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 161/320] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:58 2022] GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504 => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:50:59.441716 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-8d57a53e-8558-4546-a035-5e505e4de9e1 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:50:59.442584 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-8d57a53e-8558-4546-a035-5e505e4de9e1 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] [instance: c400550e-6713-43de-90e7-82d00c2b2cfa] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:59.445046 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:59.450756 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8d57a53e-8558-4546-a035-5e505e4de9e1 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:59.451266 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8d57a53e-8558-4546-a035-5e505e4de9e1 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:59.451700 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8d57a53e-8558-4546-a035-5e505e4de9e1 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:59.452428 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8d57a53e-8558-4546-a035-5e505e4de9e1 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:59.452878 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8d57a53e-8558-4546-a035-5e505e4de9e1 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:59.453443 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8d57a53e-8558-4546-a035-5e505e4de9e1 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:59.464870 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-a02e9971-a532-4d6d-a368-66a3fd2dd4d3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b44551c4-c873-436b-92b6-0e253b28976e"}} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:50:59.468015 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-a02e9971-a532-4d6d-a368-66a3fd2dd4d3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:50:59.473940 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.wsgi [None req-8d57a53e-8558-4546-a035-5e505e4de9e1 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] HTTP exception thrown: Instance c400550e-6713-43de-90e7-82d00c2b2cfa could not be found. Sep 03 03:50:59.475799 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a02e9971-a532-4d6d-a368-66a3fd2dd4d3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:59.476492 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a02e9971-a532-4d6d-a368-66a3fd2dd4d3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:59.477116 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a02e9971-a532-4d6d-a368-66a3fd2dd4d3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:59.478165 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a02e9971-a532-4d6d-a368-66a3fd2dd4d3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:50:59.478677 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-8d57a53e-8558-4546-a035-5e505e4de9e1 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Request method failure captured: Sep 03 03:50:59.478677 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: request: GET /compute/v2.1/servers/c400550e-6713-43de-90e7-82d00c2b2cfa HTTP/1.1 Sep 03 03:50:59.478677 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept: application/json Sep 03 03:50:59.478677 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept-Encoding: identity Sep 03 03:50:59.478677 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Connection: close Sep 03 03:50:59.478677 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Length: 0 Sep 03 03:50:59.478677 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Type: application/json Sep 03 03:50:59.478677 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Host: 10.222.0.25 Sep 03 03:50:59.478677 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Openstack-System-Scope: None Sep 03 03:50:59.478677 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: User-Agent: python-urllib3/1.26.12 Sep 03 03:50:59.478677 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Auth-Token: gAAAAABjEs7xk4wlSpTMiVXNtijm4aDfxuOWBz60_kosNoNPVXfwC4OAb6YLtZTssADJeKwWQk179_JSIRR3TATfd_pWnm3CBPJjKKav91ugFyHl-fRz_sOzc_i4qGUIG38oLOE5mrq24GYVTAAtAvIfL_TKPirYCfCYkBB519mWb_f_bhOqNIo Sep 03 03:50:59.478677 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Id: None Sep 03 03:50:59.478677 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Name: None Sep 03 03:50:59.478677 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Identity-Status: Confirmed Sep 03 03:50:59.478677 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Is-Admin-Project: True Sep 03 03:50:59.478677 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Id: default Sep 03 03:50:59.478677 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Name: Default Sep 03 03:50:59.478677 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Id: 8dc12b2499eb4f8ab6f3e216b3f6ff3e Sep 03 03:50:59.478677 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Name: tempest-VolumesActionsTest-1337461497 Sep 03 03:50:59.478677 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Role: member,reader Sep 03 03:50:59.478677 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Roles: member,reader Sep 03 03:50:59.479881 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8dc12b2499eb4f8ab6f3e216b3f6ff3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8dc12b2499eb4f8ab6f3e216b3f6ff3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8dc12b2499eb4f8ab6f3e216b3f6ff3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8dc12b2499eb4f8ab6f3e216b3f6ff3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:50:59.479881 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant: tempest-VolumesActionsTest-1337461497 Sep 03 03:50:59.479881 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Id: 8dc12b2499eb4f8ab6f3e216b3f6ff3e Sep 03 03:50:59.479881 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Name: tempest-VolumesActionsTest-1337461497 Sep 03 03:50:59.479881 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User: tempest-VolumesActionsTest-1337461497-project Sep 03 03:50:59.479881 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Id: default Sep 03 03:50:59.479881 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Name: Default Sep 03 03:50:59.479881 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Id: 658ef1a43f7d445a920e5c4f2b26e339 Sep 03 03:50:59.479881 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Name: tempest-VolumesActionsTest-1337461497-project Sep 03 03:50:59.479881 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: method: > Sep 03 03:50:59.479881 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: exception: Instance c400550e-6713-43de-90e7-82d00c2b2cfa could not be found. Sep 03 03:50:59.479881 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: action_args: {'id': 'c400550e-6713-43de-90e7-82d00c2b2cfa'} Sep 03 03:50:59.480540 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:50:59.480540 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:50:59.480540 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 03:50:59.480540 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 03:50:59.480540 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 03:50:59.480540 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 03:50:59.480540 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 03:50:59.480540 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 03:50:59.480540 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 03:50:59.480540 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 03:50:59.480540 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c400550e-6713-43de-90e7-82d00c2b2cfa could not be found. Sep 03 03:50:59.480540 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:50:59.480540 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:50:59.480540 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:50:59.480540 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:50:59.480540 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:50:59.480540 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:50:59.480540 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:50:59.480540 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:50:59.480540 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:50:59.481622 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:50:59.481622 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 03:50:59.481622 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 03:50:59.481622 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 03:50:59.481622 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 03:50:59.481622 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 03:50:59.481622 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:50:59.481622 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c400550e-6713-43de-90e7-82d00c2b2cfa could not be found. Sep 03 03:50:59.481622 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:50:59.481622 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:50:59.481622 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:50:59.481622 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:50:59.481622 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:50:59.481622 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:50:59.481622 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:50:59.481622 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:50:59.481622 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c400550e-6713-43de-90e7-82d00c2b2cfa could not be found. Sep 03 03:50:59.481622 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:50:59.483088 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-8d57a53e-8558-4546-a035-5e505e4de9e1 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] Returning 404 to user: Instance c400550e-6713-43de-90e7-82d00c2b2cfa could not be found. {{(pid=132076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:50:59.483088 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-8d57a53e-8558-4546-a035-5e505e4de9e1 tempest-VolumesActionsTest-1337461497 tempest-VolumesActionsTest-1337461497-project] 10.222.0.25 "GET /compute/v2.1/servers/c400550e-6713-43de-90e7-82d00c2b2cfa" status: 404 len: 111 microversion: 2.1 time: 0.043123 Sep 03 03:50:59.483088 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 160/321] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:50:59 2022] GET /compute/v2.1/servers/c400550e-6713-43de-90e7-82d00c2b2cfa => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 03:50:59.485344 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a02e9971-a532-4d6d-a368-66a3fd2dd4d3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:50:59.486487 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a02e9971-a532-4d6d-a368-66a3fd2dd4d3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:50:59.602129 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-9944c3ed-41e4-4254-a1a9-30cb135260f8 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1137101764", "imageRef": "0af209bb-870a-4343-a9f9-de05883bb8dd", "flavorRef": "452", "networks": [{"uuid": "8a12f613-319d-4585-b281-a9de8d8e8976"}]}} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:50:59.656863 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.network.neutron [None req-9944c3ed-41e4-4254-a1a9-30cb135260f8 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] validate_networks() for [('8a12f613-319d-4585-b281-a9de8d8e8976', None, None, None, None, None)] {{(pid=132076) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 03:51:00.024914 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-9944c3ed-41e4-4254-a1a9-30cb135260f8 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Flavor limits 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 03:51:00.025465 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-9944c3ed-41e4-4254-a1a9-30cb135260f8 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Image limits 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 03:51:00.026083 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-9944c3ed-41e4-4254-a1a9-30cb135260f8 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Flavor pref 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 03:51:00.026860 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-9944c3ed-41e4-4254-a1a9-30cb135260f8 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Image pref 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 03:51:00.027288 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-9944c3ed-41e4-4254-a1a9-30cb135260f8 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 03:51:00.036389 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9944c3ed-41e4-4254-a1a9-30cb135260f8 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:00.037000 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9944c3ed-41e4-4254-a1a9-30cb135260f8 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:00.037427 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9944c3ed-41e4-4254-a1a9-30cb135260f8 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:00.038132 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9944c3ed-41e4-4254-a1a9-30cb135260f8 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:00.038574 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9944c3ed-41e4-4254-a1a9-30cb135260f8 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:00.039024 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9944c3ed-41e4-4254-a1a9-30cb135260f8 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:00.061336 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.quota [None req-9944c3ed-41e4-4254-a1a9-30cb135260f8 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Getting quotas for project 6bafae6685e248d2ac4fab672648e941. Resources: {'ram', 'instances', 'cores'} {{(pid=132076) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 03:51:00.065275 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.quota [None req-9944c3ed-41e4-4254-a1a9-30cb135260f8 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Getting quotas for user 09f0647075204ba183fb1e5beb2c5930 and project 6bafae6685e248d2ac4fab672648e941. Resources: {'ram', 'instances', 'cores'} {{(pid=132076) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 03:51:00.076071 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-9944c3ed-41e4-4254-a1a9-30cb135260f8 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Going to run 1 instances... {{(pid=132076) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 03:51:00.078352 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-9944c3ed-41e4-4254-a1a9-30cb135260f8 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 12cfe47d-e76d-4318-b163-eacbda0af541] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0af209bb-870a-4343-a9f9-de05883bb8dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132076) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 03:51:00.124937 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-9944c3ed-41e4-4254-a1a9-30cb135260f8 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.526611 Sep 03 03:51:00.125737 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 161/322] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Sep 3 03:50:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 03 03:51:00.129979 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-98f9259a-2dba-4031-83e2-138e9eebb6c6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:00.130596 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-98f9259a-2dba-4031-83e2-138e9eebb6c6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: f7f92467-64ec-4eba-af52-ad4923543504] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:00.138256 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-98f9259a-2dba-4031-83e2-138e9eebb6c6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:00.138798 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-98f9259a-2dba-4031-83e2-138e9eebb6c6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:00.139350 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-98f9259a-2dba-4031-83e2-138e9eebb6c6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:00.140136 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-98f9259a-2dba-4031-83e2-138e9eebb6c6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:00.140611 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-98f9259a-2dba-4031-83e2-138e9eebb6c6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:00.141075 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-98f9259a-2dba-4031-83e2-138e9eebb6c6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:00.145821 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:51:00.287891 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-98f9259a-2dba-4031-83e2-138e9eebb6c6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:00.296364 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-98f9259a-2dba-4031-83e2-138e9eebb6c6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504" status: 200 len: 1510 microversion: 2.1 time: 0.169836 Sep 03 03:51:00.296997 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 162/323] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:00 2022] GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504 => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:00.301598 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-06e00511-9184-48df-94f4-7130f7ec8ec2 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:00.302200 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-06e00511-9184-48df-94f4-7130f7ec8ec2 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 12cfe47d-e76d-4318-b163-eacbda0af541] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:00.365062 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-06e00511-9184-48df-94f4-7130f7ec8ec2 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0647075204ba183fb1e5beb2c5930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bafae6685e248d2ac4fab672648e941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:00.372364 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-06e00511-9184-48df-94f4-7130f7ec8ec2 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541" status: 200 len: 1219 microversion: 2.1 time: 0.074341 Sep 03 03:51:00.372927 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 163/324] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:00 2022] GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541 => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:01.326109 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-104dc818-a001-4d43-86ce-642aa3306f86 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:01.327134 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-104dc818-a001-4d43-86ce-642aa3306f86 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: f7f92467-64ec-4eba-af52-ad4923543504] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:01.338558 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-104dc818-a001-4d43-86ce-642aa3306f86 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:01.339430 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-104dc818-a001-4d43-86ce-642aa3306f86 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:01.340215 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-104dc818-a001-4d43-86ce-642aa3306f86 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:01.341420 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-104dc818-a001-4d43-86ce-642aa3306f86 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:01.342244 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-104dc818-a001-4d43-86ce-642aa3306f86 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:01.342974 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-104dc818-a001-4d43-86ce-642aa3306f86 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:01.488218 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-104dc818-a001-4d43-86ce-642aa3306f86 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:01.496782 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-104dc818-a001-4d43-86ce-642aa3306f86 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504" status: 200 len: 1510 microversion: 2.1 time: 0.177278 Sep 03 03:51:01.497386 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 164/325] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:01 2022] GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504 => generated 1510 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:01.502087 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-cc77196d-3e11-4bc7-bda4-d63dd1d6919f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:01.502667 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-cc77196d-3e11-4bc7-bda4-d63dd1d6919f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 12cfe47d-e76d-4318-b163-eacbda0af541] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:01.508525 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cc77196d-3e11-4bc7-bda4-d63dd1d6919f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:01.509073 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cc77196d-3e11-4bc7-bda4-d63dd1d6919f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:01.509435 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cc77196d-3e11-4bc7-bda4-d63dd1d6919f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:01.510124 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cc77196d-3e11-4bc7-bda4-d63dd1d6919f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:01.510571 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cc77196d-3e11-4bc7-bda4-d63dd1d6919f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:01.511026 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cc77196d-3e11-4bc7-bda4-d63dd1d6919f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:01.569777 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-cc77196d-3e11-4bc7-bda4-d63dd1d6919f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0647075204ba183fb1e5beb2c5930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bafae6685e248d2ac4fab672648e941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:01.577535 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-cc77196d-3e11-4bc7-bda4-d63dd1d6919f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541" status: 200 len: 1223 microversion: 2.1 time: 0.079100 Sep 03 03:51:01.578255 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 165/326] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:01 2022] GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541 => generated 1223 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:02.331000 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-0d3fbfe5-d343-4baf-bcb9-f967cf3b299e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:02.331910 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-0d3fbfe5-d343-4baf-bcb9-f967cf3b299e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:02.342582 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0d3fbfe5-d343-4baf-bcb9-f967cf3b299e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:02.343450 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0d3fbfe5-d343-4baf-bcb9-f967cf3b299e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:02.344174 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0d3fbfe5-d343-4baf-bcb9-f967cf3b299e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:02.345325 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0d3fbfe5-d343-4baf-bcb9-f967cf3b299e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:02.346083 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0d3fbfe5-d343-4baf-bcb9-f967cf3b299e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:02.346538 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0d3fbfe5-d343-4baf-bcb9-f967cf3b299e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:02.370361 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-0d3fbfe5-d343-4baf-bcb9-f967cf3b299e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731/ips" status: 200 len: 145 microversion: 2.1 time: 0.045913 Sep 03 03:51:02.370907 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 166/327] 10.222.0.25 () {58 vars in 1248 bytes} [Sat Sep 3 03:51:02 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731/ips => generated 145 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:51:02.521857 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-6b777406-0e72-4bd2-9d57-63d0a5900bc2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:02.522454 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-6b777406-0e72-4bd2-9d57-63d0a5900bc2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: f7f92467-64ec-4eba-af52-ad4923543504] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:02.528837 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6b777406-0e72-4bd2-9d57-63d0a5900bc2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:02.529320 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6b777406-0e72-4bd2-9d57-63d0a5900bc2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:02.529779 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6b777406-0e72-4bd2-9d57-63d0a5900bc2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:02.530469 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6b777406-0e72-4bd2-9d57-63d0a5900bc2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:02.530949 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6b777406-0e72-4bd2-9d57-63d0a5900bc2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:02.531367 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6b777406-0e72-4bd2-9d57-63d0a5900bc2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:02.667419 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-6b777406-0e72-4bd2-9d57-63d0a5900bc2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:02.675539 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-6b777406-0e72-4bd2-9d57-63d0a5900bc2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504" status: 200 len: 1510 microversion: 2.1 time: 0.157812 Sep 03 03:51:02.676092 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 167/328] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:02 2022] GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:02.680445 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-8283564a-2e7f-4ae9-a03f-d381cd50cd83 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:02.681164 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-8283564a-2e7f-4ae9-a03f-d381cd50cd83 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 12cfe47d-e76d-4318-b163-eacbda0af541] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:02.686975 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8283564a-2e7f-4ae9-a03f-d381cd50cd83 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:02.687452 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8283564a-2e7f-4ae9-a03f-d381cd50cd83 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:02.687874 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8283564a-2e7f-4ae9-a03f-d381cd50cd83 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:02.688548 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8283564a-2e7f-4ae9-a03f-d381cd50cd83 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:02.688987 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8283564a-2e7f-4ae9-a03f-d381cd50cd83 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:02.689399 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8283564a-2e7f-4ae9-a03f-d381cd50cd83 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:02.752234 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-8283564a-2e7f-4ae9-a03f-d381cd50cd83 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0647075204ba183fb1e5beb2c5930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bafae6685e248d2ac4fab672648e941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:02.760050 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-8283564a-2e7f-4ae9-a03f-d381cd50cd83 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541" status: 200 len: 1223 microversion: 2.1 time: 0.083019 Sep 03 03:51:02.760593 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 168/329] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:02 2022] GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:03.699373 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-ceddaf54-ae65-4c56-b576-98d787b90b39 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:03.700136 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-ceddaf54-ae65-4c56-b576-98d787b90b39 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: f7f92467-64ec-4eba-af52-ad4923543504] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:03.707287 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ceddaf54-ae65-4c56-b576-98d787b90b39 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:03.707746 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ceddaf54-ae65-4c56-b576-98d787b90b39 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:03.708183 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ceddaf54-ae65-4c56-b576-98d787b90b39 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:03.708884 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ceddaf54-ae65-4c56-b576-98d787b90b39 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:03.709333 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ceddaf54-ae65-4c56-b576-98d787b90b39 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:03.709748 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ceddaf54-ae65-4c56-b576-98d787b90b39 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:03.856389 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-ceddaf54-ae65-4c56-b576-98d787b90b39 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:03.864579 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-ceddaf54-ae65-4c56-b576-98d787b90b39 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504" status: 200 len: 1510 microversion: 2.1 time: 0.169173 Sep 03 03:51:03.865138 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 169/330] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:03 2022] GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504 => generated 1510 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:03.870341 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-523c178b-97ca-4208-9c67-376a3e686a71 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:03.870958 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-523c178b-97ca-4208-9c67-376a3e686a71 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 12cfe47d-e76d-4318-b163-eacbda0af541] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:03.876724 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-523c178b-97ca-4208-9c67-376a3e686a71 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:03.877228 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-523c178b-97ca-4208-9c67-376a3e686a71 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:03.877648 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-523c178b-97ca-4208-9c67-376a3e686a71 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:03.878325 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-523c178b-97ca-4208-9c67-376a3e686a71 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:03.878763 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-523c178b-97ca-4208-9c67-376a3e686a71 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:03.879197 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-523c178b-97ca-4208-9c67-376a3e686a71 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:03.912976 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-a02e9971-a532-4d6d-a368-66a3fd2dd4d3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "POST /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.453806 Sep 03 03:51:03.913740 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 162/331] 10.222.0.25 () {60 vars in 1323 bytes} [Sat Sep 3 03:50:59 2022] POST /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911/os-volume_attachments => generated 194 bytes in 4456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:51:03.961919 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-523c178b-97ca-4208-9c67-376a3e686a71 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0647075204ba183fb1e5beb2c5930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bafae6685e248d2ac4fab672648e941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:03.972852 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-523c178b-97ca-4208-9c67-376a3e686a71 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541" status: 200 len: 1215 microversion: 2.1 time: 0.106391 Sep 03 03:51:03.982731 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 170/332] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:03 2022] GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541 => generated 1215 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:04.888994 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-0453da03-8ab7-4049-8fa4-6f70b079e079 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:04.889735 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-0453da03-8ab7-4049-8fa4-6f70b079e079 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: f7f92467-64ec-4eba-af52-ad4923543504] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:04.896535 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0453da03-8ab7-4049-8fa4-6f70b079e079 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:04.896998 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0453da03-8ab7-4049-8fa4-6f70b079e079 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:04.897440 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0453da03-8ab7-4049-8fa4-6f70b079e079 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:04.898126 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0453da03-8ab7-4049-8fa4-6f70b079e079 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:04.898552 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0453da03-8ab7-4049-8fa4-6f70b079e079 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:04.899113 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0453da03-8ab7-4049-8fa4-6f70b079e079 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:04.922007 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-064b5ba9-6a4d-4756-ab2c-d870c8aab157 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:04.922549 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-064b5ba9-6a4d-4756-ab2c-d870c8aab157 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:04.933596 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-064b5ba9-6a4d-4756-ab2c-d870c8aab157 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:04.934096 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-064b5ba9-6a4d-4756-ab2c-d870c8aab157 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:04.934558 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-064b5ba9-6a4d-4756-ab2c-d870c8aab157 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:04.935302 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-064b5ba9-6a4d-4756-ab2c-d870c8aab157 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:04.935745 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-064b5ba9-6a4d-4756-ab2c-d870c8aab157 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:04.936166 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-064b5ba9-6a4d-4756-ab2c-d870c8aab157 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:04.961103 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-064b5ba9-6a4d-4756-ab2c-d870c8aab157 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78/ips" status: 200 len: 151 microversion: 2.20 time: 0.042956 Sep 03 03:51:04.961678 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 171/333] 10.222.0.25 () {60 vars in 1289 bytes} [Sat Sep 3 03:51:04 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 03:51:04.997517 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-d47c72fd-88f5-46a6-a188-54b18a1c739e tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:04.998129 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-d47c72fd-88f5-46a6-a188-54b18a1c739e tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 12cfe47d-e76d-4318-b163-eacbda0af541] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:05.004326 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d47c72fd-88f5-46a6-a188-54b18a1c739e tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:05.004912 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d47c72fd-88f5-46a6-a188-54b18a1c739e tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:05.005348 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d47c72fd-88f5-46a6-a188-54b18a1c739e tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:05.006079 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d47c72fd-88f5-46a6-a188-54b18a1c739e tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:05.006523 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d47c72fd-88f5-46a6-a188-54b18a1c739e tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:05.007444 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d47c72fd-88f5-46a6-a188-54b18a1c739e tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:05.040914 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-0453da03-8ab7-4049-8fa4-6f70b079e079 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:05.053392 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-0453da03-8ab7-4049-8fa4-6f70b079e079 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504" status: 200 len: 1516 microversion: 2.1 time: 0.169072 Sep 03 03:51:05.054485 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 163/334] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:04 2022] GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504 => generated 1516 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:05.071652 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-d47c72fd-88f5-46a6-a188-54b18a1c739e tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0647075204ba183fb1e5beb2c5930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bafae6685e248d2ac4fab672648e941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:05.080764 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-d47c72fd-88f5-46a6-a188-54b18a1c739e tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541" status: 200 len: 1271 microversion: 2.1 time: 0.087538 Sep 03 03:51:05.081341 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 172/335] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:04 2022] GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541 => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:05.701669 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-58494846-70df-4e6a-ad50-7bb9cb8b20e2 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0daeb897-d847-440d-b3bf-823ac3484d96"}} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:51:05.704640 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-58494846-70df-4e6a-ad50-7bb9cb8b20e2 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:05.718835 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-58494846-70df-4e6a-ad50-7bb9cb8b20e2 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:05.724007 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-58494846-70df-4e6a-ad50-7bb9cb8b20e2 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:05.724607 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-58494846-70df-4e6a-ad50-7bb9cb8b20e2 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:05.725506 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-58494846-70df-4e6a-ad50-7bb9cb8b20e2 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:05.726262 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-58494846-70df-4e6a-ad50-7bb9cb8b20e2 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:05.726860 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-58494846-70df-4e6a-ad50-7bb9cb8b20e2 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:05.786688 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:51:06.110280 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-a8cb2248-c2f9-4078-b950-630228bc1b24 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:06.112215 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-a8cb2248-c2f9-4078-b950-630228bc1b24 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 12cfe47d-e76d-4318-b163-eacbda0af541] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:06.128823 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a8cb2248-c2f9-4078-b950-630228bc1b24 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:06.131024 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a8cb2248-c2f9-4078-b950-630228bc1b24 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:06.132298 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a8cb2248-c2f9-4078-b950-630228bc1b24 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:06.155490 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a8cb2248-c2f9-4078-b950-630228bc1b24 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:06.156640 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a8cb2248-c2f9-4078-b950-630228bc1b24 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:06.157447 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a8cb2248-c2f9-4078-b950-630228bc1b24 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:06.170292 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-58494846-70df-4e6a-ad50-7bb9cb8b20e2 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "POST /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.472488 Sep 03 03:51:06.176671 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 164/336] 10.222.0.25 () {60 vars in 1323 bytes} [Sat Sep 3 03:51:05 2022] POST /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731/os-volume_attachments => generated 194 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:51:06.267997 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-a8cb2248-c2f9-4078-b950-630228bc1b24 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0647075204ba183fb1e5beb2c5930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bafae6685e248d2ac4fab672648e941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:06.297298 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-a8cb2248-c2f9-4078-b950-630228bc1b24 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541" status: 200 len: 1277 microversion: 2.1 time: 0.196604 Sep 03 03:51:06.298316 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 173/337] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:06 2022] GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541 => generated 1277 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:06.881948 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-587baa1c-f08e-409f-ad1b-d4d584b436e8 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Action: 'create', calling method: .version_select at 0x7f45fc9e2af0>, body: {"keypair": {"name": "tempest-keypair-564165630", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCmzJP0rf05ljSkMelTWeubu+mtx6UrdPYQA+db6oj0kxdeUkh3Ba1IdSeVR+qz3Wq7UL3dxHo+Wq9GbCtyTvibxEXveNyULaGuGALPBoyvDvTDlwcvAr7vE7ebYHECNQ=="}} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:51:06.897975 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.quota [None req-587baa1c-f08e-409f-ad1b-d4d584b436e8 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Getting quotas for project f3077cfc588042e0a1becefe1363385c. Resources: {'key_pairs'} {{(pid=132077) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 03:51:06.902261 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.quota [None req-587baa1c-f08e-409f-ad1b-d4d584b436e8 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Getting quotas for user ba00478a6ef74115b83726083026f574 and project f3077cfc588042e0a1becefe1363385c. Resources: {'key_pairs'} {{(pid=132077) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 03:51:06.927345 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-587baa1c-f08e-409f-ad1b-d4d584b436e8 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050069 Sep 03 03:51:06.928456 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 165/338] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Sep 3 03:51:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:51:07.326429 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-e2ba1683-9481-4e13-91fc-6cfcef9b12dd tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:07.327947 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-e2ba1683-9481-4e13-91fc-6cfcef9b12dd tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 12cfe47d-e76d-4318-b163-eacbda0af541] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:07.348806 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e2ba1683-9481-4e13-91fc-6cfcef9b12dd tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:07.350711 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e2ba1683-9481-4e13-91fc-6cfcef9b12dd tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:07.352694 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e2ba1683-9481-4e13-91fc-6cfcef9b12dd tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:07.353647 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e2ba1683-9481-4e13-91fc-6cfcef9b12dd tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:07.359050 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e2ba1683-9481-4e13-91fc-6cfcef9b12dd tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:07.359589 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e2ba1683-9481-4e13-91fc-6cfcef9b12dd tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:07.514952 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-848e52b3-7067-4298-960b-9a94dea3c673 req-52a61823-be42-46bf-a84f-1e45d14f42b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12cfe47d-e76d-4318-b163-eacbda0af541", "tag": "6cda611e-3725-48d2-aa18-b249345b2805"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:51:07.537670 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-848e52b3-7067-4298-960b-9a94dea3c673 req-52a61823-be42-46bf-a84f-1e45d14f42b9 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:07.538081 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-848e52b3-7067-4298-960b-9a94dea3c673 req-52a61823-be42-46bf-a84f-1e45d14f42b9 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:07.539593 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-848e52b3-7067-4298-960b-9a94dea3c673 req-52a61823-be42-46bf-a84f-1e45d14f42b9 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:07.584709 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-848e52b3-7067-4298-960b-9a94dea3c673 req-52a61823-be42-46bf-a84f-1e45d14f42b9 service nova] Creating event network-changed:6cda611e-3725-48d2-aa18-b249345b2805 for instance 12cfe47d-e76d-4318-b163-eacbda0af541 on hv-cinder-79966 Sep 03 03:51:07.590065 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-848e52b3-7067-4298-960b-9a94dea3c673 req-52a61823-be42-46bf-a84f-1e45d14f42b9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081067 Sep 03 03:51:07.591080 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 166/339] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 03:51:07.640928 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-a9756f26-e824-4cb9-9853-4cf55ac3a674 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:51:07.641899 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-a9756f26-e824-4cb9-9853-4cf55ac3a674 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:07.653123 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a9756f26-e824-4cb9-9853-4cf55ac3a674 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:07.654443 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a9756f26-e824-4cb9-9853-4cf55ac3a674 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:07.658325 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a9756f26-e824-4cb9-9853-4cf55ac3a674 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:07.659690 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a9756f26-e824-4cb9-9853-4cf55ac3a674 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:07.664852 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a9756f26-e824-4cb9-9853-4cf55ac3a674 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:07.665755 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a9756f26-e824-4cb9-9853-4cf55ac3a674 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:07.731347 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.objects.instance [None req-a9756f26-e824-4cb9-9853-4cf55ac3a674 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lazy-loading 'flavor' on Instance uuid 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 {{(pid=132077) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 03:51:07.774254 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-e2ba1683-9481-4e13-91fc-6cfcef9b12dd tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0647075204ba183fb1e5beb2c5930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bafae6685e248d2ac4fab672648e941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:07.792788 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-e2ba1683-9481-4e13-91fc-6cfcef9b12dd tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541" status: 200 len: 1319 microversion: 2.1 time: 0.470811 Sep 03 03:51:07.802114 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 174/340] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:07 2022] GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541 => generated 1319 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:08.077159 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-a9756f26-e824-4cb9-9853-4cf55ac3a674 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "POST /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78/action" status: 202 len: 0 microversion: 2.20 time: 0.442781 Sep 03 03:51:08.078574 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 167/341] 10.222.0.25 () {62 vars in 1319 bytes} [Sat Sep 3 03:51:07 2022] POST /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78/action => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 03 03:51:08.087242 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-9a40d82b-2095-4648-8bb9-8bdb84dc679a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:08.087770 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-9a40d82b-2095-4648-8bb9-8bdb84dc679a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:08.097513 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9a40d82b-2095-4648-8bb9-8bdb84dc679a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:08.098267 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9a40d82b-2095-4648-8bb9-8bdb84dc679a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:08.099219 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9a40d82b-2095-4648-8bb9-8bdb84dc679a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:08.100275 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9a40d82b-2095-4648-8bb9-8bdb84dc679a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:08.100923 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9a40d82b-2095-4648-8bb9-8bdb84dc679a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:08.101562 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9a40d82b-2095-4648-8bb9-8bdb84dc679a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:08.365484 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-9a40d82b-2095-4648-8bb9-8bdb84dc679a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:08.379107 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-9a40d82b-2095-4648-8bb9-8bdb84dc679a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:08.381661 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-9a40d82b-2095-4648-8bb9-8bdb84dc679a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:08.383575 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-9a40d82b-2095-4648-8bb9-8bdb84dc679a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1723 microversion: 2.20 time: 0.300095 Sep 03 03:51:08.384643 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 175/342] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:08 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1723 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:51:08.828653 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-61f141c1-54c8-42ab-9e90-663dd8e917c4 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:08.832572 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-61f141c1-54c8-42ab-9e90-663dd8e917c4 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 12cfe47d-e76d-4318-b163-eacbda0af541] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:08.841332 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-61f141c1-54c8-42ab-9e90-663dd8e917c4 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:08.842207 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-61f141c1-54c8-42ab-9e90-663dd8e917c4 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:08.843019 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-61f141c1-54c8-42ab-9e90-663dd8e917c4 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:08.844524 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-61f141c1-54c8-42ab-9e90-663dd8e917c4 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:08.848975 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-61f141c1-54c8-42ab-9e90-663dd8e917c4 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:08.850346 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-61f141c1-54c8-42ab-9e90-663dd8e917c4 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:09.147774 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-61f141c1-54c8-42ab-9e90-663dd8e917c4 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0647075204ba183fb1e5beb2c5930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bafae6685e248d2ac4fab672648e941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:09.167254 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-61f141c1-54c8-42ab-9e90-663dd8e917c4 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541" status: 200 len: 1319 microversion: 2.1 time: 0.336848 Sep 03 03:51:09.169855 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 168/343] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:08 2022] GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541 => generated 1319 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:09.327316 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-02c27fc3-df67-4b1b-940d-50af484b15c6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1343065668", "imageRef": "0af209bb-870a-4343-a9f9-de05883bb8dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "623f82bb-85e8-446e-8a72-4128e524e83a"}], "security_groups": [{"name": "tempest-securitygroup--400571320"}], "key_name": "tempest-keypair-564165630", "user_data": "}} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:51:09.409406 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-130b71a9-4578-4669-9dce-7498570af254 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:09.410006 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-130b71a9-4578-4669-9dce-7498570af254 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:09.426839 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-130b71a9-4578-4669-9dce-7498570af254 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:09.427342 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-130b71a9-4578-4669-9dce-7498570af254 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:09.427771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-130b71a9-4578-4669-9dce-7498570af254 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:09.428484 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-130b71a9-4578-4669-9dce-7498570af254 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:09.428916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-130b71a9-4578-4669-9dce-7498570af254 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:09.431716 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-130b71a9-4578-4669-9dce-7498570af254 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:09.519992 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.network.neutron [None req-02c27fc3-df67-4b1b-940d-50af484b15c6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] validate_networks() for [('623f82bb-85e8-446e-8a72-4128e524e83a', None, None, None, None, None)] {{(pid=132076) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 03:51:09.659857 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-130b71a9-4578-4669-9dce-7498570af254 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:09.668406 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-130b71a9-4578-4669-9dce-7498570af254 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:09.669995 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-130b71a9-4578-4669-9dce-7498570af254 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:09.671444 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-130b71a9-4578-4669-9dce-7498570af254 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1723 microversion: 2.20 time: 0.265968 Sep 03 03:51:09.685979 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 169/344] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:09 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:51:10.046433 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell0:SELECT=2 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:51:10.188344 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-ad4169a4-daeb-4c1c-b67e-1041be8a05b5 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:10.189627 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-ad4169a4-daeb-4c1c-b67e-1041be8a05b5 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 12cfe47d-e76d-4318-b163-eacbda0af541] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:10.199178 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ad4169a4-daeb-4c1c-b67e-1041be8a05b5 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:10.199686 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ad4169a4-daeb-4c1c-b67e-1041be8a05b5 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:10.200095 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ad4169a4-daeb-4c1c-b67e-1041be8a05b5 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:10.200969 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ad4169a4-daeb-4c1c-b67e-1041be8a05b5 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:10.203217 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ad4169a4-daeb-4c1c-b67e-1041be8a05b5 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:10.203818 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ad4169a4-daeb-4c1c-b67e-1041be8a05b5 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:10.265307 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-02c27fc3-df67-4b1b-940d-50af484b15c6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Flavor limits 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 03:51:10.265725 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-02c27fc3-df67-4b1b-940d-50af484b15c6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Image limits 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 03:51:10.266378 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-02c27fc3-df67-4b1b-940d-50af484b15c6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Flavor pref 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 03:51:10.266971 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-02c27fc3-df67-4b1b-940d-50af484b15c6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Image pref 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 03:51:10.267565 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-02c27fc3-df67-4b1b-940d-50af484b15c6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 03:51:10.278375 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-02c27fc3-df67-4b1b-940d-50af484b15c6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:10.279743 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-02c27fc3-df67-4b1b-940d-50af484b15c6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:10.280453 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-02c27fc3-df67-4b1b-940d-50af484b15c6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:10.281951 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-02c27fc3-df67-4b1b-940d-50af484b15c6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:10.282577 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-02c27fc3-df67-4b1b-940d-50af484b15c6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:10.283121 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-02c27fc3-df67-4b1b-940d-50af484b15c6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:10.303389 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.quota [None req-02c27fc3-df67-4b1b-940d-50af484b15c6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Getting quotas for project f3077cfc588042e0a1becefe1363385c. Resources: {'ram', 'instances', 'cores'} {{(pid=132076) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 03:51:10.308079 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.quota [None req-02c27fc3-df67-4b1b-940d-50af484b15c6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Getting quotas for user ba00478a6ef74115b83726083026f574 and project f3077cfc588042e0a1becefe1363385c. Resources: {'ram', 'instances', 'cores'} {{(pid=132076) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 03:51:10.322090 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-02c27fc3-df67-4b1b-940d-50af484b15c6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Going to run 1 instances... {{(pid=132076) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 03:51:10.324543 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-02c27fc3-df67-4b1b-940d-50af484b15c6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0af209bb-870a-4343-a9f9-de05883bb8dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132076) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 03:51:10.397998 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-02c27fc3-df67-4b1b-940d-50af484b15c6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.076185 Sep 03 03:51:10.408526 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 176/345] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Sep 3 03:51:09 2022] POST /compute/v2.1/servers => generated 408 bytes in 1087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 03 03:51:10.411725 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-ad4169a4-daeb-4c1c-b67e-1041be8a05b5 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0647075204ba183fb1e5beb2c5930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bafae6685e248d2ac4fab672648e941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:10.422503 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-ad4169a4-daeb-4c1c-b67e-1041be8a05b5 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541" status: 200 len: 1319 microversion: 2.1 time: 0.237885 Sep 03 03:51:10.424699 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 170/346] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:10 2022] GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541 => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:51:10.430489 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-51255495-11e9-4987-95e6-128648a40824 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:10.431336 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-51255495-11e9-4987-95e6-128648a40824 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:10.700552 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-dbad7a26-278c-4339-bd3f-18c95d6a4bc4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:10.701139 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-dbad7a26-278c-4339-bd3f-18c95d6a4bc4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:10.705812 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-51255495-11e9-4987-95e6-128648a40824 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:10.718506 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-51255495-11e9-4987-95e6-128648a40824 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1245 microversion: 2.1 time: 0.303344 Sep 03 03:51:10.719729 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-dbad7a26-278c-4339-bd3f-18c95d6a4bc4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:10.721939 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-dbad7a26-278c-4339-bd3f-18c95d6a4bc4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:10.722982 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-dbad7a26-278c-4339-bd3f-18c95d6a4bc4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:10.723715 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-dbad7a26-278c-4339-bd3f-18c95d6a4bc4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:10.724379 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 177/347] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:10 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1245 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:10.727314 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-dbad7a26-278c-4339-bd3f-18c95d6a4bc4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:10.727917 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-dbad7a26-278c-4339-bd3f-18c95d6a4bc4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:10.960776 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-dbad7a26-278c-4339-bd3f-18c95d6a4bc4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:10.972210 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-dbad7a26-278c-4339-bd3f-18c95d6a4bc4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:10.974292 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-dbad7a26-278c-4339-bd3f-18c95d6a4bc4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:10.975534 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-dbad7a26-278c-4339-bd3f-18c95d6a4bc4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1723 microversion: 2.20 time: 0.281289 Sep 03 03:51:10.976307 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 171/348] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:10 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:51:11.458249 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-558d608c-acfa-489c-ba3c-691f2cfff8af tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:11.459681 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-558d608c-acfa-489c-ba3c-691f2cfff8af tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 12cfe47d-e76d-4318-b163-eacbda0af541] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:11.478285 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-558d608c-acfa-489c-ba3c-691f2cfff8af tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:11.478787 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-558d608c-acfa-489c-ba3c-691f2cfff8af tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:11.479471 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-558d608c-acfa-489c-ba3c-691f2cfff8af tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:11.480367 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-558d608c-acfa-489c-ba3c-691f2cfff8af tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:11.480973 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-558d608c-acfa-489c-ba3c-691f2cfff8af tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:11.481545 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-558d608c-acfa-489c-ba3c-691f2cfff8af tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:11.746651 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-16896e18-11b8-4807-ae96-d5bb0f3c67db tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:11.749957 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-16896e18-11b8-4807-ae96-d5bb0f3c67db tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:11.824297 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-16896e18-11b8-4807-ae96-d5bb0f3c67db tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:11.824797 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-16896e18-11b8-4807-ae96-d5bb0f3c67db tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:11.825223 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-16896e18-11b8-4807-ae96-d5bb0f3c67db tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:11.825920 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-16896e18-11b8-4807-ae96-d5bb0f3c67db tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:11.826438 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-16896e18-11b8-4807-ae96-d5bb0f3c67db tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:11.826788 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-16896e18-11b8-4807-ae96-d5bb0f3c67db tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:12.007030 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-16896e18-11b8-4807-ae96-d5bb0f3c67db tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:12.017985 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-16896e18-11b8-4807-ae96-d5bb0f3c67db tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1297 microversion: 2.1 time: 0.276065 Sep 03 03:51:12.020488 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 172/349] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:11 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1297 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:12.025539 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-0aa46bbc-ffbb-4283-9128-4df9ec851765 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:12.026413 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-0aa46bbc-ffbb-4283-9128-4df9ec851765 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:12.045368 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0aa46bbc-ffbb-4283-9128-4df9ec851765 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:12.047375 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0aa46bbc-ffbb-4283-9128-4df9ec851765 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:12.054546 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0aa46bbc-ffbb-4283-9128-4df9ec851765 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:12.057319 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0aa46bbc-ffbb-4283-9128-4df9ec851765 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:12.058200 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0aa46bbc-ffbb-4283-9128-4df9ec851765 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:12.059789 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0aa46bbc-ffbb-4283-9128-4df9ec851765 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:12.077110 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-558d608c-acfa-489c-ba3c-691f2cfff8af tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0647075204ba183fb1e5beb2c5930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bafae6685e248d2ac4fab672648e941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:12.091478 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-558d608c-acfa-489c-ba3c-691f2cfff8af tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541" status: 200 len: 1319 microversion: 2.1 time: 0.638714 Sep 03 03:51:12.092072 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 178/350] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:11 2022] GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541 => generated 1319 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:12.113474 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-ee473242-6dc7-4ac7-9d14-3209275c3a6e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Action: 'create', calling method: .version_select at 0x7f45fc9bcf70>, body: {"keypair": {"name": "tempest-keypair-465855499", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMXsAuDcaG1ARQMMe6KPVEgVLsbuNhLADCF4qsPMg3evoIkyQP+bwX5r/KEKeoiFpdzzxkPMtN9j6zqPE2iDPuQlZ8P44U+VYPPOBrlqlLOS2KxIWTZ5kax2ke8TKLsXQ=="}} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:51:12.180631 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.quota [None req-ee473242-6dc7-4ac7-9d14-3209275c3a6e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Getting quotas for project ac9e77355ba040bda4f2186753df7b24. Resources: {'key_pairs'} {{(pid=132076) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 03:51:12.196630 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.quota [None req-ee473242-6dc7-4ac7-9d14-3209275c3a6e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Getting quotas for user 1dde7fad075145c89f726ca85c6c00ba and project ac9e77355ba040bda4f2186753df7b24. Resources: {'key_pairs'} {{(pid=132076) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 03:51:12.251498 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-ee473242-6dc7-4ac7-9d14-3209275c3a6e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.152818 Sep 03 03:51:12.262008 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 179/351] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Sep 3 03:51:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:51:12.398319 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-0aa46bbc-ffbb-4283-9128-4df9ec851765 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:12.409755 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-0aa46bbc-ffbb-4283-9128-4df9ec851765 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:12.412847 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-0aa46bbc-ffbb-4283-9128-4df9ec851765 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:12.417644 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-0aa46bbc-ffbb-4283-9128-4df9ec851765 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1723 microversion: 2.20 time: 0.395804 Sep 03 03:51:12.420010 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 173/352] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:12 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1723 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:51:12.712323 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-8fbd73f5-0e1d-43ab-928e-47496cb09603 req-4b156f77-5f7a-4c1a-a1d4-449c870d1a40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12cfe47d-e76d-4318-b163-eacbda0af541", "name": "network-vif-plugged", "status": "completed", "tag": "6cda611e-3725-48d2-aa18-b249345b2805"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:51:12.742089 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-8fbd73f5-0e1d-43ab-928e-47496cb09603 req-4b156f77-5f7a-4c1a-a1d4-449c870d1a40 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:12.742571 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-8fbd73f5-0e1d-43ab-928e-47496cb09603 req-4b156f77-5f7a-4c1a-a1d4-449c870d1a40 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:12.743041 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-8fbd73f5-0e1d-43ab-928e-47496cb09603 req-4b156f77-5f7a-4c1a-a1d4-449c870d1a40 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:12.781551 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-8fbd73f5-0e1d-43ab-928e-47496cb09603 req-4b156f77-5f7a-4c1a-a1d4-449c870d1a40 service nova] Creating event network-vif-plugged:6cda611e-3725-48d2-aa18-b249345b2805 for instance 12cfe47d-e76d-4318-b163-eacbda0af541 on hv-cinder-79966 Sep 03 03:51:12.800692 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-8fbd73f5-0e1d-43ab-928e-47496cb09603 req-4b156f77-5f7a-4c1a-a1d4-449c870d1a40 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092726 Sep 03 03:51:12.808494 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 180/353] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:51:13.044711 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-421d787b-c410-4e9e-83a8-e68f761dd2e6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:13.045318 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-421d787b-c410-4e9e-83a8-e68f761dd2e6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:13.066006 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-421d787b-c410-4e9e-83a8-e68f761dd2e6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:13.066515 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-421d787b-c410-4e9e-83a8-e68f761dd2e6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:13.067000 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-421d787b-c410-4e9e-83a8-e68f761dd2e6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:13.067742 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-421d787b-c410-4e9e-83a8-e68f761dd2e6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:13.068185 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-421d787b-c410-4e9e-83a8-e68f761dd2e6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:13.068607 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-421d787b-c410-4e9e-83a8-e68f761dd2e6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:13.119834 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-b7877a53-d76c-4ae1-a852-27dc42d60ae1 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:13.120697 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-b7877a53-d76c-4ae1-a852-27dc42d60ae1 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 12cfe47d-e76d-4318-b163-eacbda0af541] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:13.136417 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b7877a53-d76c-4ae1-a852-27dc42d60ae1 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:13.137362 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b7877a53-d76c-4ae1-a852-27dc42d60ae1 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:13.137973 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b7877a53-d76c-4ae1-a852-27dc42d60ae1 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:13.139266 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b7877a53-d76c-4ae1-a852-27dc42d60ae1 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:13.139886 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b7877a53-d76c-4ae1-a852-27dc42d60ae1 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:13.140478 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b7877a53-d76c-4ae1-a852-27dc42d60ae1 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:13.260016 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-421d787b-c410-4e9e-83a8-e68f761dd2e6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:13.270492 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-421d787b-c410-4e9e-83a8-e68f761dd2e6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1315 microversion: 2.1 time: 0.229606 Sep 03 03:51:13.271100 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 174/354] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:13 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:13.447056 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-b7877a53-d76c-4ae1-a852-27dc42d60ae1 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0647075204ba183fb1e5beb2c5930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bafae6685e248d2ac4fab672648e941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:13.453017 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-ba658199-15cc-4380-8f89-33110b617afb tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:13.454275 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-ba658199-15cc-4380-8f89-33110b617afb tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:13.459689 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-b7877a53-d76c-4ae1-a852-27dc42d60ae1 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541" status: 200 len: 1319 microversion: 2.1 time: 0.344457 Sep 03 03:51:13.460282 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 181/355] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:13 2022] GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541 => generated 1319 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:13.466094 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ba658199-15cc-4380-8f89-33110b617afb tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:13.468099 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ba658199-15cc-4380-8f89-33110b617afb tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:13.470092 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ba658199-15cc-4380-8f89-33110b617afb tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:13.474180 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ba658199-15cc-4380-8f89-33110b617afb tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:13.475238 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ba658199-15cc-4380-8f89-33110b617afb tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:13.475903 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ba658199-15cc-4380-8f89-33110b617afb tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:14.202106 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-ba658199-15cc-4380-8f89-33110b617afb tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:14.244396 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-ba658199-15cc-4380-8f89-33110b617afb tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:14.246701 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-ba658199-15cc-4380-8f89-33110b617afb tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:14.248613 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-ba658199-15cc-4380-8f89-33110b617afb tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1723 microversion: 2.20 time: 0.803033 Sep 03 03:51:14.249787 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 175/356] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:13 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1723 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:51:14.295480 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-514f7261-153c-44f1-bb01-b31356a1e085 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:14.296423 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-514f7261-153c-44f1-bb01-b31356a1e085 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:14.306660 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-514f7261-153c-44f1-bb01-b31356a1e085 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:14.307190 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-514f7261-153c-44f1-bb01-b31356a1e085 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:14.307629 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-514f7261-153c-44f1-bb01-b31356a1e085 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:14.310168 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-514f7261-153c-44f1-bb01-b31356a1e085 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:14.310641 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-514f7261-153c-44f1-bb01-b31356a1e085 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:14.311094 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-514f7261-153c-44f1-bb01-b31356a1e085 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:14.516206 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-34199fdd-ac68-4359-9dc7-f8d9fe448139 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:14.516895 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-34199fdd-ac68-4359-9dc7-f8d9fe448139 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 12cfe47d-e76d-4318-b163-eacbda0af541] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:14.529848 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-34199fdd-ac68-4359-9dc7-f8d9fe448139 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:14.532191 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-34199fdd-ac68-4359-9dc7-f8d9fe448139 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:14.533783 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-34199fdd-ac68-4359-9dc7-f8d9fe448139 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:14.535419 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-34199fdd-ac68-4359-9dc7-f8d9fe448139 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:14.537900 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-34199fdd-ac68-4359-9dc7-f8d9fe448139 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:14.539089 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-34199fdd-ac68-4359-9dc7-f8d9fe448139 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:14.554696 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-514f7261-153c-44f1-bb01-b31356a1e085 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:14.563624 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-514f7261-153c-44f1-bb01-b31356a1e085 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1370 microversion: 2.1 time: 0.272636 Sep 03 03:51:14.564621 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 182/357] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:14 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1370 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:14.800620 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-34199fdd-ac68-4359-9dc7-f8d9fe448139 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0647075204ba183fb1e5beb2c5930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bafae6685e248d2ac4fab672648e941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:14.810241 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-34199fdd-ac68-4359-9dc7-f8d9fe448139 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541" status: 200 len: 1319 microversion: 2.1 time: 0.298534 Sep 03 03:51:14.811254 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 176/358] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:14 2022] GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541 => generated 1319 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:15.085909 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-48054e85-753c-4f76-bd30-01fddf3be057 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-427870032", "imageRef": "0af209bb-870a-4343-a9f9-de05883bb8dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3310a324-39c6-4074-b839-e8b47e45dc07"}], "security_groups": [{"name": "tempest-securitygroup--1685421146"}], "key_name": "tempest-keypair-465855499", "user_data": "}} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:51:15.280579 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-8e31f58f-daf7-4256-b968-bdad2fff8ad5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:15.281912 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-8e31f58f-daf7-4256-b968-bdad2fff8ad5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:15.292851 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8e31f58f-daf7-4256-b968-bdad2fff8ad5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:15.297285 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.network.neutron [None req-48054e85-753c-4f76-bd30-01fddf3be057 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] validate_networks() for [('3310a324-39c6-4074-b839-e8b47e45dc07', None, None, None, None, None)] {{(pid=132076) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 03:51:15.304992 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8e31f58f-daf7-4256-b968-bdad2fff8ad5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:15.305836 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8e31f58f-daf7-4256-b968-bdad2fff8ad5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:15.309120 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8e31f58f-daf7-4256-b968-bdad2fff8ad5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:15.310091 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8e31f58f-daf7-4256-b968-bdad2fff8ad5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:15.310926 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8e31f58f-daf7-4256-b968-bdad2fff8ad5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:15.478697 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-8e31f58f-daf7-4256-b968-bdad2fff8ad5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:15.487501 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-8e31f58f-daf7-4256-b968-bdad2fff8ad5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:15.489758 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-8e31f58f-daf7-4256-b968-bdad2fff8ad5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:15.491142 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-8e31f58f-daf7-4256-b968-bdad2fff8ad5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1723 microversion: 2.20 time: 0.215216 Sep 03 03:51:15.513976 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 177/359] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:15 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 03:51:15.590184 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-cad29c27-1538-4567-aac3-dfb3194f1513 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:15.590975 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-cad29c27-1538-4567-aac3-dfb3194f1513 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:15.597319 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cad29c27-1538-4567-aac3-dfb3194f1513 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:15.598048 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cad29c27-1538-4567-aac3-dfb3194f1513 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:15.600000 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cad29c27-1538-4567-aac3-dfb3194f1513 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:15.600781 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cad29c27-1538-4567-aac3-dfb3194f1513 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:15.601299 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cad29c27-1538-4567-aac3-dfb3194f1513 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:15.601907 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cad29c27-1538-4567-aac3-dfb3194f1513 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:15.767442 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-cad29c27-1538-4567-aac3-dfb3194f1513 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:15.782446 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-cad29c27-1538-4567-aac3-dfb3194f1513 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1370 microversion: 2.1 time: 0.195580 Sep 03 03:51:15.783896 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 178/360] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:15 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1370 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:15.845369 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-84c72089-5c5f-47c7-b051-6dc3115d657b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:15.846417 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-84c72089-5c5f-47c7-b051-6dc3115d657b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 12cfe47d-e76d-4318-b163-eacbda0af541] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:15.854772 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-84c72089-5c5f-47c7-b051-6dc3115d657b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:15.856088 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-84c72089-5c5f-47c7-b051-6dc3115d657b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:15.856967 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-84c72089-5c5f-47c7-b051-6dc3115d657b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:15.858204 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-84c72089-5c5f-47c7-b051-6dc3115d657b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:15.858908 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-84c72089-5c5f-47c7-b051-6dc3115d657b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:15.859425 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-84c72089-5c5f-47c7-b051-6dc3115d657b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:15.884467 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:51:16.009815 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-48054e85-753c-4f76-bd30-01fddf3be057 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Flavor limits 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 03:51:16.010203 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-48054e85-753c-4f76-bd30-01fddf3be057 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Image limits 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 03:51:16.010662 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-48054e85-753c-4f76-bd30-01fddf3be057 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Flavor pref 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 03:51:16.011096 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-48054e85-753c-4f76-bd30-01fddf3be057 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Image pref 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 03:51:16.011496 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-48054e85-753c-4f76-bd30-01fddf3be057 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 03:51:16.012611 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-84c72089-5c5f-47c7-b051-6dc3115d657b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0647075204ba183fb1e5beb2c5930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bafae6685e248d2ac4fab672648e941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:16.023097 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-84c72089-5c5f-47c7-b051-6dc3115d657b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541" status: 200 len: 1507 microversion: 2.1 time: 0.193327 Sep 03 03:51:16.023662 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 179/361] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:15 2022] GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541 => generated 1507 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:16.041829 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-48054e85-753c-4f76-bd30-01fddf3be057 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:16.042314 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-48054e85-753c-4f76-bd30-01fddf3be057 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:16.042745 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-48054e85-753c-4f76-bd30-01fddf3be057 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:16.051972 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-48054e85-753c-4f76-bd30-01fddf3be057 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:16.052982 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-48054e85-753c-4f76-bd30-01fddf3be057 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:16.053670 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-48054e85-753c-4f76-bd30-01fddf3be057 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:16.070541 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-08ce1a95-2224-4f9f-a2aa-d96a656cf9fb req-2b7f7a60-a32f-4fdb-8c69-a582502d2643 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f5b827b-0905-4360-b0b5-f5881a029bc2", "tag": "9f1ab985-1982-45d9-b595-93496be6d12f"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:51:16.087147 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.quota [None req-48054e85-753c-4f76-bd30-01fddf3be057 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Getting quotas for project ac9e77355ba040bda4f2186753df7b24. Resources: {'ram', 'instances', 'cores'} {{(pid=132076) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 03:51:16.092023 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.quota [None req-48054e85-753c-4f76-bd30-01fddf3be057 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Getting quotas for user 1dde7fad075145c89f726ca85c6c00ba and project ac9e77355ba040bda4f2186753df7b24. Resources: {'ram', 'instances', 'cores'} {{(pid=132076) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 03:51:16.098089 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-08ce1a95-2224-4f9f-a2aa-d96a656cf9fb req-2b7f7a60-a32f-4fdb-8c69-a582502d2643 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:16.099236 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-08ce1a95-2224-4f9f-a2aa-d96a656cf9fb req-2b7f7a60-a32f-4fdb-8c69-a582502d2643 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:16.106754 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:51:16.113175 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-08ce1a95-2224-4f9f-a2aa-d96a656cf9fb req-2b7f7a60-a32f-4fdb-8c69-a582502d2643 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:16.119824 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-48054e85-753c-4f76-bd30-01fddf3be057 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Going to run 1 instances... {{(pid=132076) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 03:51:16.123411 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-48054e85-753c-4f76-bd30-01fddf3be057 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: f23f06ef-2db1-4e7b-a2f4-71927f83b40d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0af209bb-870a-4343-a9f9-de05883bb8dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132076) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 03:51:16.155112 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-08ce1a95-2224-4f9f-a2aa-d96a656cf9fb req-2b7f7a60-a32f-4fdb-8c69-a582502d2643 service nova] Creating event network-changed:9f1ab985-1982-45d9-b595-93496be6d12f for instance 4f5b827b-0905-4360-b0b5-f5881a029bc2 on hv-cinder-79966 Sep 03 03:51:16.165295 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-08ce1a95-2224-4f9f-a2aa-d96a656cf9fb req-2b7f7a60-a32f-4fdb-8c69-a582502d2643 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101897 Sep 03 03:51:16.166366 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 180/362] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:51:16.195030 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-48054e85-753c-4f76-bd30-01fddf3be057 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.114251 Sep 03 03:51:16.196202 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 183/363] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Sep 3 03:51:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 1116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 03:51:16.213899 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-418d164e-f288-4421-ab27-8878c53a6833 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:16.217988 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-418d164e-f288-4421-ab27-8878c53a6833 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: f23f06ef-2db1-4e7b-a2f4-71927f83b40d] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:16.344070 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-418d164e-f288-4421-ab27-8878c53a6833 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:16.355772 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-418d164e-f288-4421-ab27-8878c53a6833 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d" status: 200 len: 1240 microversion: 2.1 time: 0.151554 Sep 03 03:51:16.356436 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 181/364] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:16 2022] GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d => generated 1240 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:16.522128 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-3ec41387-d936-4edb-89fd-415ecef19860 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:16.523645 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-3ec41387-d936-4edb-89fd-415ecef19860 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:16.532699 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3ec41387-d936-4edb-89fd-415ecef19860 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:16.533635 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3ec41387-d936-4edb-89fd-415ecef19860 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:16.534218 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3ec41387-d936-4edb-89fd-415ecef19860 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:16.535104 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3ec41387-d936-4edb-89fd-415ecef19860 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:16.535762 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3ec41387-d936-4edb-89fd-415ecef19860 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:16.537125 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3ec41387-d936-4edb-89fd-415ecef19860 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:16.568726 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell1:SELECT=100 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:51:16.805804 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-9794bd62-ef67-44c5-9d6e-940ed7d3ee93 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:16.806718 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-9794bd62-ef67-44c5-9d6e-940ed7d3ee93 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:16.820146 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9794bd62-ef67-44c5-9d6e-940ed7d3ee93 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:16.820672 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9794bd62-ef67-44c5-9d6e-940ed7d3ee93 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:16.821113 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9794bd62-ef67-44c5-9d6e-940ed7d3ee93 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:16.821833 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9794bd62-ef67-44c5-9d6e-940ed7d3ee93 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:16.822282 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9794bd62-ef67-44c5-9d6e-940ed7d3ee93 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:16.822701 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9794bd62-ef67-44c5-9d6e-940ed7d3ee93 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:16.866852 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-3ec41387-d936-4edb-89fd-415ecef19860 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:16.885226 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-3ec41387-d936-4edb-89fd-415ecef19860 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:16.887191 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-3ec41387-d936-4edb-89fd-415ecef19860 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:16.888964 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-3ec41387-d936-4edb-89fd-415ecef19860 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1723 microversion: 2.20 time: 0.371043 Sep 03 03:51:16.911555 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 184/365] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:16 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1723 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:51:17.024041 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-9794bd62-ef67-44c5-9d6e-940ed7d3ee93 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:17.036262 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-9794bd62-ef67-44c5-9d6e-940ed7d3ee93 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1370 microversion: 2.1 time: 0.234517 Sep 03 03:51:17.037326 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 182/366] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:16 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1370 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:17.378211 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-f844c691-972d-4a08-ab71-dbdf6db40042 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:17.379159 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-f844c691-972d-4a08-ab71-dbdf6db40042 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: f23f06ef-2db1-4e7b-a2f4-71927f83b40d] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:17.385330 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f844c691-972d-4a08-ab71-dbdf6db40042 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:17.385979 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f844c691-972d-4a08-ab71-dbdf6db40042 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:17.386410 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f844c691-972d-4a08-ab71-dbdf6db40042 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:17.387149 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f844c691-972d-4a08-ab71-dbdf6db40042 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:17.387610 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f844c691-972d-4a08-ab71-dbdf6db40042 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:17.388026 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f844c691-972d-4a08-ab71-dbdf6db40042 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:17.453549 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-f844c691-972d-4a08-ab71-dbdf6db40042 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:17.463851 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-f844c691-972d-4a08-ab71-dbdf6db40042 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d" status: 200 len: 1244 microversion: 2.1 time: 0.089211 Sep 03 03:51:17.464635 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 185/367] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:17 2022] GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d => generated 1244 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:17.923092 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-6555086c-4cf8-4456-98df-c16caccdafe5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:17.923705 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-6555086c-4cf8-4456-98df-c16caccdafe5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:17.945375 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6555086c-4cf8-4456-98df-c16caccdafe5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:17.945375 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6555086c-4cf8-4456-98df-c16caccdafe5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:17.945375 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6555086c-4cf8-4456-98df-c16caccdafe5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:17.945375 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6555086c-4cf8-4456-98df-c16caccdafe5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:17.945936 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6555086c-4cf8-4456-98df-c16caccdafe5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:17.945936 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6555086c-4cf8-4456-98df-c16caccdafe5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:18.063249 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-c1c1a10c-669b-4a43-a0bd-0ae60ebc4e15 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:18.065361 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-c1c1a10c-669b-4a43-a0bd-0ae60ebc4e15 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:18.080491 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c1c1a10c-669b-4a43-a0bd-0ae60ebc4e15 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:18.081798 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c1c1a10c-669b-4a43-a0bd-0ae60ebc4e15 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:18.082442 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c1c1a10c-669b-4a43-a0bd-0ae60ebc4e15 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:18.083819 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c1c1a10c-669b-4a43-a0bd-0ae60ebc4e15 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:18.085517 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-6555086c-4cf8-4456-98df-c16caccdafe5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:18.085880 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c1c1a10c-669b-4a43-a0bd-0ae60ebc4e15 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:18.086618 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c1c1a10c-669b-4a43-a0bd-0ae60ebc4e15 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:18.093820 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-6555086c-4cf8-4456-98df-c16caccdafe5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:18.095311 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-6555086c-4cf8-4456-98df-c16caccdafe5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:18.096468 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-6555086c-4cf8-4456-98df-c16caccdafe5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1723 microversion: 2.20 time: 0.181256 Sep 03 03:51:18.097325 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 183/368] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:17 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:51:18.233857 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-c1c1a10c-669b-4a43-a0bd-0ae60ebc4e15 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:18.244225 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-c1c1a10c-669b-4a43-a0bd-0ae60ebc4e15 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1370 microversion: 2.1 time: 0.187126 Sep 03 03:51:18.245100 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 186/369] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:18 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1370 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:18.487371 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-7e775ac0-9c7f-4584-b8ec-fc07f89d6d95 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:18.488043 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-7e775ac0-9c7f-4584-b8ec-fc07f89d6d95 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: f23f06ef-2db1-4e7b-a2f4-71927f83b40d] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:18.494743 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7e775ac0-9c7f-4584-b8ec-fc07f89d6d95 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:18.495281 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7e775ac0-9c7f-4584-b8ec-fc07f89d6d95 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:18.495963 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7e775ac0-9c7f-4584-b8ec-fc07f89d6d95 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:18.496874 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7e775ac0-9c7f-4584-b8ec-fc07f89d6d95 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:18.497912 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7e775ac0-9c7f-4584-b8ec-fc07f89d6d95 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:18.498507 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7e775ac0-9c7f-4584-b8ec-fc07f89d6d95 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:18.567321 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-7e775ac0-9c7f-4584-b8ec-fc07f89d6d95 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:18.575895 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-7e775ac0-9c7f-4584-b8ec-fc07f89d6d95 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d" status: 200 len: 1244 microversion: 2.1 time: 0.092372 Sep 03 03:51:18.576758 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 184/370] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:18 2022] GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d => generated 1244 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:51:19.122846 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-250a3644-2b1f-44e6-b017-b839dd3a5576 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:19.125921 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-250a3644-2b1f-44e6-b017-b839dd3a5576 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:19.136560 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-250a3644-2b1f-44e6-b017-b839dd3a5576 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:19.142516 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-250a3644-2b1f-44e6-b017-b839dd3a5576 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:19.143312 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-250a3644-2b1f-44e6-b017-b839dd3a5576 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:19.146549 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-250a3644-2b1f-44e6-b017-b839dd3a5576 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:19.147062 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-250a3644-2b1f-44e6-b017-b839dd3a5576 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:19.147482 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-250a3644-2b1f-44e6-b017-b839dd3a5576 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:19.267378 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-954a268f-1bb9-472f-87a5-9da36e45cf87 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:19.268174 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-954a268f-1bb9-472f-87a5-9da36e45cf87 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:19.274658 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-954a268f-1bb9-472f-87a5-9da36e45cf87 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:19.275232 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-954a268f-1bb9-472f-87a5-9da36e45cf87 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:19.275666 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-954a268f-1bb9-472f-87a5-9da36e45cf87 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:19.276955 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-954a268f-1bb9-472f-87a5-9da36e45cf87 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:19.277590 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-954a268f-1bb9-472f-87a5-9da36e45cf87 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:19.278084 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-954a268f-1bb9-472f-87a5-9da36e45cf87 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:19.293364 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-250a3644-2b1f-44e6-b017-b839dd3a5576 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:19.301731 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-250a3644-2b1f-44e6-b017-b839dd3a5576 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:19.303224 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-250a3644-2b1f-44e6-b017-b839dd3a5576 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:19.304387 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-250a3644-2b1f-44e6-b017-b839dd3a5576 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1723 microversion: 2.20 time: 0.186543 Sep 03 03:51:19.310876 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 187/371] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:19 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:51:19.415965 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-954a268f-1bb9-472f-87a5-9da36e45cf87 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:19.423931 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-954a268f-1bb9-472f-87a5-9da36e45cf87 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1370 microversion: 2.1 time: 0.160375 Sep 03 03:51:19.424489 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 185/372] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:19 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:51:19.599861 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-b011c45c-519e-4141-890a-45fff5e2b329 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:19.600780 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-b011c45c-519e-4141-890a-45fff5e2b329 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: f23f06ef-2db1-4e7b-a2f4-71927f83b40d] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:19.613114 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b011c45c-519e-4141-890a-45fff5e2b329 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:19.613640 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b011c45c-519e-4141-890a-45fff5e2b329 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:19.614075 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b011c45c-519e-4141-890a-45fff5e2b329 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:19.616952 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b011c45c-519e-4141-890a-45fff5e2b329 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:19.617429 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b011c45c-519e-4141-890a-45fff5e2b329 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:19.617863 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b011c45c-519e-4141-890a-45fff5e2b329 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:19.716695 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-b011c45c-519e-4141-890a-45fff5e2b329 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:19.740760 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-b011c45c-519e-4141-890a-45fff5e2b329 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d" status: 200 len: 1292 microversion: 2.1 time: 0.142266 Sep 03 03:51:19.742640 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 188/373] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:19 2022] GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d => generated 1292 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:51:20.331014 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-66f10895-c144-4b1e-b4cf-038a9593c2a2 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:20.331813 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-66f10895-c144-4b1e-b4cf-038a9593c2a2 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:20.339282 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-66f10895-c144-4b1e-b4cf-038a9593c2a2 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:20.340163 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-66f10895-c144-4b1e-b4cf-038a9593c2a2 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:20.340686 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-66f10895-c144-4b1e-b4cf-038a9593c2a2 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:20.341470 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-66f10895-c144-4b1e-b4cf-038a9593c2a2 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:20.342032 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-66f10895-c144-4b1e-b4cf-038a9593c2a2 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:20.342540 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-66f10895-c144-4b1e-b4cf-038a9593c2a2 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:20.450936 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-d18c43ae-18b5-4715-bb94-b47341573b2e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:20.452781 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-d18c43ae-18b5-4715-bb94-b47341573b2e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:20.465120 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d18c43ae-18b5-4715-bb94-b47341573b2e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:20.466233 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d18c43ae-18b5-4715-bb94-b47341573b2e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:20.466871 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d18c43ae-18b5-4715-bb94-b47341573b2e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:20.467829 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d18c43ae-18b5-4715-bb94-b47341573b2e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:20.468661 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d18c43ae-18b5-4715-bb94-b47341573b2e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:20.469329 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d18c43ae-18b5-4715-bb94-b47341573b2e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:20.533765 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-66f10895-c144-4b1e-b4cf-038a9593c2a2 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:20.547391 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-66f10895-c144-4b1e-b4cf-038a9593c2a2 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:20.549286 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-66f10895-c144-4b1e-b4cf-038a9593c2a2 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:20.552365 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-66f10895-c144-4b1e-b4cf-038a9593c2a2 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1723 microversion: 2.20 time: 0.225599 Sep 03 03:51:20.553157 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 186/374] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:20 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 03:51:20.760158 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-d18c43ae-18b5-4715-bb94-b47341573b2e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:20.774088 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-d18c43ae-18b5-4715-bb94-b47341573b2e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1370 microversion: 2.1 time: 0.328564 Sep 03 03:51:20.774417 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-6a15d2cd-fe22-4ecf-a910-c3caf4a4a49f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:20.776245 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 189/375] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:20 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1370 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:20.777421 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-6a15d2cd-fe22-4ecf-a910-c3caf4a4a49f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: f23f06ef-2db1-4e7b-a2f4-71927f83b40d] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:20.791785 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6a15d2cd-fe22-4ecf-a910-c3caf4a4a49f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:20.800755 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6a15d2cd-fe22-4ecf-a910-c3caf4a4a49f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:20.801202 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6a15d2cd-fe22-4ecf-a910-c3caf4a4a49f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:20.801976 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6a15d2cd-fe22-4ecf-a910-c3caf4a4a49f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:20.817128 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6a15d2cd-fe22-4ecf-a910-c3caf4a4a49f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:20.817128 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6a15d2cd-fe22-4ecf-a910-c3caf4a4a49f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:20.835763 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-205638d4-a046-40fc-8b3e-4807fd21b02f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:51:20.849611 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-205638d4-a046-40fc-8b3e-4807fd21b02f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:20.850124 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-205638d4-a046-40fc-8b3e-4807fd21b02f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:20.850563 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-205638d4-a046-40fc-8b3e-4807fd21b02f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:20.919514 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-6a15d2cd-fe22-4ecf-a910-c3caf4a4a49f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:20.930536 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-6a15d2cd-fe22-4ecf-a910-c3caf4a4a49f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d" status: 200 len: 1310 microversion: 2.1 time: 0.166473 Sep 03 03:51:20.934247 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 187/376] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:20 2022] GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d => generated 1310 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:20.966640 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-205638d4-a046-40fc-8b3e-4807fd21b02f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Going to try to stop instance {{(pid=132076) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 03 03:51:21.025871 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-205638d4-a046-40fc-8b3e-4807fd21b02f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "POST /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731/action" status: 202 len: 0 microversion: 2.1 time: 0.195910 Sep 03 03:51:21.026686 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 190/377] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Sep 3 03:51:20 2022] POST /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 03 03:51:21.041280 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-a43abcd4-f3fe-459e-87e2-3d89f0ea1bc8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:21.042224 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-a43abcd4-f3fe-459e-87e2-3d89f0ea1bc8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:21.052777 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a43abcd4-f3fe-459e-87e2-3d89f0ea1bc8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:21.054009 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a43abcd4-f3fe-459e-87e2-3d89f0ea1bc8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:21.055256 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a43abcd4-f3fe-459e-87e2-3d89f0ea1bc8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:21.057098 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a43abcd4-f3fe-459e-87e2-3d89f0ea1bc8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:21.057775 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a43abcd4-f3fe-459e-87e2-3d89f0ea1bc8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:21.058310 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a43abcd4-f3fe-459e-87e2-3d89f0ea1bc8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:21.325964 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a43abcd4-f3fe-459e-87e2-3d89f0ea1bc8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:21.339807 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-a43abcd4-f3fe-459e-87e2-3d89f0ea1bc8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1724 microversion: 2.1 time: 0.307943 Sep 03 03:51:21.348204 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 188/378] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:21 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1724 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:21.578984 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-bd3d8d22-b309-4fac-b6c3-77441672035f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:21.580374 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-bd3d8d22-b309-4fac-b6c3-77441672035f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:21.587602 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-bd3d8d22-b309-4fac-b6c3-77441672035f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:21.588388 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-bd3d8d22-b309-4fac-b6c3-77441672035f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:21.589047 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-bd3d8d22-b309-4fac-b6c3-77441672035f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:21.589769 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-bd3d8d22-b309-4fac-b6c3-77441672035f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:21.590240 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-bd3d8d22-b309-4fac-b6c3-77441672035f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:21.590907 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-bd3d8d22-b309-4fac-b6c3-77441672035f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:21.802368 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-f565b5bb-e755-449b-8623-2b6f79788aaa tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:21.803632 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-f565b5bb-e755-449b-8623-2b6f79788aaa tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:21.811084 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f565b5bb-e755-449b-8623-2b6f79788aaa tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:21.811881 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f565b5bb-e755-449b-8623-2b6f79788aaa tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:21.812436 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f565b5bb-e755-449b-8623-2b6f79788aaa tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:21.814224 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f565b5bb-e755-449b-8623-2b6f79788aaa tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:21.814900 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f565b5bb-e755-449b-8623-2b6f79788aaa tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:21.815597 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f565b5bb-e755-449b-8623-2b6f79788aaa tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:21.816110 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-bd3d8d22-b309-4fac-b6c3-77441672035f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:21.832765 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-bd3d8d22-b309-4fac-b6c3-77441672035f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:21.834312 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-bd3d8d22-b309-4fac-b6c3-77441672035f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:21.836511 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-bd3d8d22-b309-4fac-b6c3-77441672035f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1723 microversion: 2.20 time: 0.262265 Sep 03 03:51:21.837901 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 191/379] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:21 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:51:21.958245 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-e132a914-5289-45f2-b36c-02b157243c87 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:21.959333 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-e132a914-5289-45f2-b36c-02b157243c87 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: f23f06ef-2db1-4e7b-a2f4-71927f83b40d] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:21.973494 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e132a914-5289-45f2-b36c-02b157243c87 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:21.975292 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e132a914-5289-45f2-b36c-02b157243c87 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:21.976339 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e132a914-5289-45f2-b36c-02b157243c87 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:21.977585 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e132a914-5289-45f2-b36c-02b157243c87 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:21.978124 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e132a914-5289-45f2-b36c-02b157243c87 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:21.978795 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e132a914-5289-45f2-b36c-02b157243c87 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:21.983772 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-f565b5bb-e755-449b-8623-2b6f79788aaa tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:21.994532 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-f565b5bb-e755-449b-8623-2b6f79788aaa tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1370 microversion: 2.1 time: 0.196416 Sep 03 03:51:22.006986 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 189/380] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:21 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1370 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:22.294669 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-e132a914-5289-45f2-b36c-02b157243c87 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:22.305440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-e132a914-5289-45f2-b36c-02b157243c87 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d" status: 200 len: 1366 microversion: 2.1 time: 0.351076 Sep 03 03:51:22.316406 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 192/381] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:21 2022] GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d => generated 1366 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:51:22.374290 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-9b94b053-35d6-4b59-b2c1-b9a23868d115 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:22.374879 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-9b94b053-35d6-4b59-b2c1-b9a23868d115 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:22.382672 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9b94b053-35d6-4b59-b2c1-b9a23868d115 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:22.383082 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9b94b053-35d6-4b59-b2c1-b9a23868d115 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:22.383523 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9b94b053-35d6-4b59-b2c1-b9a23868d115 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:22.384219 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9b94b053-35d6-4b59-b2c1-b9a23868d115 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:22.384858 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9b94b053-35d6-4b59-b2c1-b9a23868d115 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:22.385426 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9b94b053-35d6-4b59-b2c1-b9a23868d115 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:22.621481 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-9b94b053-35d6-4b59-b2c1-b9a23868d115 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:22.635896 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-9e3ebc00-4922-435d-b0a6-1947f8bcb8b6 req-54235be8-8885-4baf-9b60-32048cb71d29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f5b827b-0905-4360-b0b5-f5881a029bc2", "name": "network-vif-plugged", "status": "completed", "tag": "9f1ab985-1982-45d9-b595-93496be6d12f"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:51:22.644769 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-9b94b053-35d6-4b59-b2c1-b9a23868d115 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1724 microversion: 2.1 time: 0.274672 Sep 03 03:51:22.645930 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 190/382] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:22 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1724 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:22.661340 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-9e3ebc00-4922-435d-b0a6-1947f8bcb8b6 req-54235be8-8885-4baf-9b60-32048cb71d29 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:22.661848 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-9e3ebc00-4922-435d-b0a6-1947f8bcb8b6 req-54235be8-8885-4baf-9b60-32048cb71d29 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:22.667430 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-9e3ebc00-4922-435d-b0a6-1947f8bcb8b6 req-54235be8-8885-4baf-9b60-32048cb71d29 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:22.682105 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-9e3ebc00-4922-435d-b0a6-1947f8bcb8b6 req-54235be8-8885-4baf-9b60-32048cb71d29 service nova] Creating event network-vif-plugged:9f1ab985-1982-45d9-b595-93496be6d12f for instance 4f5b827b-0905-4360-b0b5-f5881a029bc2 on hv-cinder-79966 Sep 03 03:51:22.687493 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-9e3ebc00-4922-435d-b0a6-1947f8bcb8b6 req-54235be8-8885-4baf-9b60-32048cb71d29 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055766 Sep 03 03:51:22.688585 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 193/383] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:51:22.865094 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-0811c639-4c77-478e-b850-0398112a39f6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:22.866285 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-0811c639-4c77-478e-b850-0398112a39f6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:22.880791 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0811c639-4c77-478e-b850-0398112a39f6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:22.886904 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0811c639-4c77-478e-b850-0398112a39f6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:22.887628 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0811c639-4c77-478e-b850-0398112a39f6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:22.888536 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0811c639-4c77-478e-b850-0398112a39f6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:22.889180 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0811c639-4c77-478e-b850-0398112a39f6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:22.889595 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0811c639-4c77-478e-b850-0398112a39f6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:23.029886 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-285c2dd4-86d3-4fb7-8f9c-55a507bb1f59 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:23.030708 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-285c2dd4-86d3-4fb7-8f9c-55a507bb1f59 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:23.056560 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-285c2dd4-86d3-4fb7-8f9c-55a507bb1f59 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:23.057415 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-285c2dd4-86d3-4fb7-8f9c-55a507bb1f59 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:23.057900 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-285c2dd4-86d3-4fb7-8f9c-55a507bb1f59 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:23.058838 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-285c2dd4-86d3-4fb7-8f9c-55a507bb1f59 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:23.059455 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-285c2dd4-86d3-4fb7-8f9c-55a507bb1f59 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:23.059795 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-285c2dd4-86d3-4fb7-8f9c-55a507bb1f59 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:23.149939 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-0811c639-4c77-478e-b850-0398112a39f6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:23.161348 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-0811c639-4c77-478e-b850-0398112a39f6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:23.163450 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-0811c639-4c77-478e-b850-0398112a39f6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:23.166042 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-0811c639-4c77-478e-b850-0398112a39f6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1723 microversion: 2.20 time: 0.307485 Sep 03 03:51:23.167291 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 191/384] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:22 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1723 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:51:23.318844 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-285c2dd4-86d3-4fb7-8f9c-55a507bb1f59 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:23.348427 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-f2130c2f-8808-4677-92fb-d9e2dd0ab303 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:23.349217 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-f2130c2f-8808-4677-92fb-d9e2dd0ab303 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: f23f06ef-2db1-4e7b-a2f4-71927f83b40d] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:23.358927 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-285c2dd4-86d3-4fb7-8f9c-55a507bb1f59 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1370 microversion: 2.1 time: 0.337742 Sep 03 03:51:23.363737 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 194/385] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:23 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1370 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:23.368690 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f2130c2f-8808-4677-92fb-d9e2dd0ab303 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:23.370014 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f2130c2f-8808-4677-92fb-d9e2dd0ab303 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:23.375932 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f2130c2f-8808-4677-92fb-d9e2dd0ab303 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:23.376694 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f2130c2f-8808-4677-92fb-d9e2dd0ab303 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:23.377160 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f2130c2f-8808-4677-92fb-d9e2dd0ab303 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:23.377599 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f2130c2f-8808-4677-92fb-d9e2dd0ab303 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:23.382043 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-48f75937-c1ae-43be-90d2-d81f01e115a8 req-effdeacc-4c22-43d9-8cfe-31c239683ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f23f06ef-2db1-4e7b-a2f4-71927f83b40d", "tag": "7375a989-9439-4258-b7ff-865576ed3c85"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:51:23.407519 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-48f75937-c1ae-43be-90d2-d81f01e115a8 req-effdeacc-4c22-43d9-8cfe-31c239683ed9 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:23.408435 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-48f75937-c1ae-43be-90d2-d81f01e115a8 req-effdeacc-4c22-43d9-8cfe-31c239683ed9 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:23.408859 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-48f75937-c1ae-43be-90d2-d81f01e115a8 req-effdeacc-4c22-43d9-8cfe-31c239683ed9 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:23.427326 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-48f75937-c1ae-43be-90d2-d81f01e115a8 req-effdeacc-4c22-43d9-8cfe-31c239683ed9 service nova] Creating event network-changed:7375a989-9439-4258-b7ff-865576ed3c85 for instance f23f06ef-2db1-4e7b-a2f4-71927f83b40d on hv-cinder-79966 Sep 03 03:51:23.432044 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-48f75937-c1ae-43be-90d2-d81f01e115a8 req-effdeacc-4c22-43d9-8cfe-31c239683ed9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060539 Sep 03 03:51:23.432822 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 195/386] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:51:23.547368 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-f2130c2f-8808-4677-92fb-d9e2dd0ab303 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:23.555503 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-f2130c2f-8808-4677-92fb-d9e2dd0ab303 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d" status: 200 len: 1366 microversion: 2.1 time: 0.219173 Sep 03 03:51:23.556427 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 192/387] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:23 2022] GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:23.673083 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-fa24f59e-8124-4cb6-a508-ee087738ff94 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:23.673957 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-fa24f59e-8124-4cb6-a508-ee087738ff94 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:23.680413 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fa24f59e-8124-4cb6-a508-ee087738ff94 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:23.681267 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fa24f59e-8124-4cb6-a508-ee087738ff94 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:23.681857 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fa24f59e-8124-4cb6-a508-ee087738ff94 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:23.682545 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fa24f59e-8124-4cb6-a508-ee087738ff94 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:23.683180 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fa24f59e-8124-4cb6-a508-ee087738ff94 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:23.683594 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fa24f59e-8124-4cb6-a508-ee087738ff94 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:23.864037 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-fa24f59e-8124-4cb6-a508-ee087738ff94 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:23.874574 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-fa24f59e-8124-4cb6-a508-ee087738ff94 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1724 microversion: 2.1 time: 0.206169 Sep 03 03:51:23.875487 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 196/388] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:23 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:24.192519 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-e19ee44c-54cd-4a82-b05b-a2b6b428562f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:24.193120 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-e19ee44c-54cd-4a82-b05b-a2b6b428562f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:24.199548 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e19ee44c-54cd-4a82-b05b-a2b6b428562f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:24.200050 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e19ee44c-54cd-4a82-b05b-a2b6b428562f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:24.200477 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e19ee44c-54cd-4a82-b05b-a2b6b428562f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:24.201173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e19ee44c-54cd-4a82-b05b-a2b6b428562f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:24.201777 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e19ee44c-54cd-4a82-b05b-a2b6b428562f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:24.202025 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e19ee44c-54cd-4a82-b05b-a2b6b428562f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:24.364762 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-e19ee44c-54cd-4a82-b05b-a2b6b428562f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:24.373286 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-e19ee44c-54cd-4a82-b05b-a2b6b428562f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:24.374724 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-e19ee44c-54cd-4a82-b05b-a2b6b428562f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:24.376786 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-e19ee44c-54cd-4a82-b05b-a2b6b428562f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1723 microversion: 2.20 time: 0.188293 Sep 03 03:51:24.395925 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 193/389] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:24 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:51:24.399835 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-e8b3c96e-46b4-474d-a132-25724335035b tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:24.400648 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-e8b3c96e-46b4-474d-a132-25724335035b tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:24.407165 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e8b3c96e-46b4-474d-a132-25724335035b tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:24.408049 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e8b3c96e-46b4-474d-a132-25724335035b tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:24.408661 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e8b3c96e-46b4-474d-a132-25724335035b tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:24.409531 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e8b3c96e-46b4-474d-a132-25724335035b tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:24.410135 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e8b3c96e-46b4-474d-a132-25724335035b tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:24.410699 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e8b3c96e-46b4-474d-a132-25724335035b tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:24.578089 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-a6a21634-4d61-47bd-b661-22383aa613eb tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:24.578712 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-a6a21634-4d61-47bd-b661-22383aa613eb tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: f23f06ef-2db1-4e7b-a2f4-71927f83b40d] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:24.585426 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a6a21634-4d61-47bd-b661-22383aa613eb tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:24.586030 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a6a21634-4d61-47bd-b661-22383aa613eb tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:24.586893 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a6a21634-4d61-47bd-b661-22383aa613eb tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:24.587758 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a6a21634-4d61-47bd-b661-22383aa613eb tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:24.588206 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a6a21634-4d61-47bd-b661-22383aa613eb tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:24.588614 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a6a21634-4d61-47bd-b661-22383aa613eb tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:24.620889 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-e8b3c96e-46b4-474d-a132-25724335035b tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:24.636382 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-e8b3c96e-46b4-474d-a132-25724335035b tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1370 microversion: 2.1 time: 0.244229 Sep 03 03:51:24.637270 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 197/390] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:24 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1370 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:24.729849 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a6a21634-4d61-47bd-b661-22383aa613eb tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:24.738592 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-a6a21634-4d61-47bd-b661-22383aa613eb tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d" status: 200 len: 1366 microversion: 2.1 time: 0.164242 Sep 03 03:51:24.739199 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 194/391] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:24 2022] GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:51:24.898134 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-7aa9ee40-8eac-477b-9f0a-117aca1419ad tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:24.898753 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-7aa9ee40-8eac-477b-9f0a-117aca1419ad tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:24.906785 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7aa9ee40-8eac-477b-9f0a-117aca1419ad tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:24.907296 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7aa9ee40-8eac-477b-9f0a-117aca1419ad tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:24.907831 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7aa9ee40-8eac-477b-9f0a-117aca1419ad tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:24.908719 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7aa9ee40-8eac-477b-9f0a-117aca1419ad tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:24.909160 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7aa9ee40-8eac-477b-9f0a-117aca1419ad tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:24.909913 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7aa9ee40-8eac-477b-9f0a-117aca1419ad tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:25.060961 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-7aa9ee40-8eac-477b-9f0a-117aca1419ad tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:25.069442 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-7aa9ee40-8eac-477b-9f0a-117aca1419ad tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1724 microversion: 2.1 time: 0.175442 Sep 03 03:51:25.070382 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 198/392] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:24 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:25.406257 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-0e90c486-dd7e-4485-8e9d-4bcb9b0cbacc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:25.406968 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-0e90c486-dd7e-4485-8e9d-4bcb9b0cbacc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:25.418246 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0e90c486-dd7e-4485-8e9d-4bcb9b0cbacc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:25.418767 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0e90c486-dd7e-4485-8e9d-4bcb9b0cbacc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:25.419866 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0e90c486-dd7e-4485-8e9d-4bcb9b0cbacc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:25.420160 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0e90c486-dd7e-4485-8e9d-4bcb9b0cbacc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:25.421449 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0e90c486-dd7e-4485-8e9d-4bcb9b0cbacc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:25.425596 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0e90c486-dd7e-4485-8e9d-4bcb9b0cbacc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:25.590724 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-0e90c486-dd7e-4485-8e9d-4bcb9b0cbacc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:25.600202 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-0e90c486-dd7e-4485-8e9d-4bcb9b0cbacc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:25.603673 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-0e90c486-dd7e-4485-8e9d-4bcb9b0cbacc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:25.604999 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-0e90c486-dd7e-4485-8e9d-4bcb9b0cbacc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1723 microversion: 2.20 time: 0.203018 Sep 03 03:51:25.619343 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 195/393] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:25 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:51:25.662795 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-a975bc1f-b01f-4b89-9b2f-b6ff1be468df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:25.663512 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-a975bc1f-b01f-4b89-9b2f-b6ff1be468df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:25.672331 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a975bc1f-b01f-4b89-9b2f-b6ff1be468df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:25.673140 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a975bc1f-b01f-4b89-9b2f-b6ff1be468df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:25.673794 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a975bc1f-b01f-4b89-9b2f-b6ff1be468df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:25.674707 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a975bc1f-b01f-4b89-9b2f-b6ff1be468df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:25.675181 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a975bc1f-b01f-4b89-9b2f-b6ff1be468df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:25.675782 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a975bc1f-b01f-4b89-9b2f-b6ff1be468df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:25.764419 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-1c936e08-ea9d-43af-886f-71cc7eb8e987 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:25.765414 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-1c936e08-ea9d-43af-886f-71cc7eb8e987 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: f23f06ef-2db1-4e7b-a2f4-71927f83b40d] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:25.774277 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1c936e08-ea9d-43af-886f-71cc7eb8e987 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:25.775140 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1c936e08-ea9d-43af-886f-71cc7eb8e987 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:25.775794 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1c936e08-ea9d-43af-886f-71cc7eb8e987 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:25.776848 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1c936e08-ea9d-43af-886f-71cc7eb8e987 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:25.777306 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1c936e08-ea9d-43af-886f-71cc7eb8e987 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:25.778248 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1c936e08-ea9d-43af-886f-71cc7eb8e987 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:25.836205 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-a975bc1f-b01f-4b89-9b2f-b6ff1be468df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:25.844828 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-a975bc1f-b01f-4b89-9b2f-b6ff1be468df tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1565 microversion: 2.1 time: 0.186336 Sep 03 03:51:25.845403 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 199/394] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:25 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1565 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:25.872242 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-24c40b1c-6e38-4ba0-819a-66e10869b652 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:25.872755 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-24c40b1c-6e38-4ba0-819a-66e10869b652 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:25.881697 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-24c40b1c-6e38-4ba0-819a-66e10869b652 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:25.882438 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-24c40b1c-6e38-4ba0-819a-66e10869b652 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:25.882944 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-24c40b1c-6e38-4ba0-819a-66e10869b652 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:25.883740 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-24c40b1c-6e38-4ba0-819a-66e10869b652 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:25.885010 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-24c40b1c-6e38-4ba0-819a-66e10869b652 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:25.885583 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-24c40b1c-6e38-4ba0-819a-66e10869b652 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:25.932259 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-1c936e08-ea9d-43af-886f-71cc7eb8e987 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:25.951037 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-1c936e08-ea9d-43af-886f-71cc7eb8e987 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d" status: 200 len: 1366 microversion: 2.1 time: 0.191454 Sep 03 03:51:25.952003 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 196/395] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:25 2022] GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:51:25.985062 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-24c40b1c-6e38-4ba0-819a-66e10869b652 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.120069 Sep 03 03:51:25.987062 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 200/396] 10.222.0.25 () {58 vars in 1275 bytes} [Sat Sep 3 03:51:25 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2/os-interface => generated 285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:51:26.100203 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-eca7f452-6e98-4dd9-9c56-02e4f9d52892 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:26.102052 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-eca7f452-6e98-4dd9-9c56-02e4f9d52892 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:26.113389 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eca7f452-6e98-4dd9-9c56-02e4f9d52892 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:26.114442 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eca7f452-6e98-4dd9-9c56-02e4f9d52892 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:26.115001 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eca7f452-6e98-4dd9-9c56-02e4f9d52892 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:26.115871 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eca7f452-6e98-4dd9-9c56-02e4f9d52892 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:26.116334 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eca7f452-6e98-4dd9-9c56-02e4f9d52892 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:26.116770 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eca7f452-6e98-4dd9-9c56-02e4f9d52892 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:26.349730 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell0:SELECT=6 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:51:26.389411 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-eca7f452-6e98-4dd9-9c56-02e4f9d52892 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:26.394335 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell1:SELECT=100 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:51:26.405439 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-eca7f452-6e98-4dd9-9c56-02e4f9d52892 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1724 microversion: 2.1 time: 0.311562 Sep 03 03:51:26.406559 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 197/397] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:26 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1724 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:26.628573 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell0:SELECT=4 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:51:26.629376 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell0:SELECT=26 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:51:26.636057 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-c10459e4-4093-4530-97a5-62ca2e4c2131 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:26.637084 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-c10459e4-4093-4530-97a5-62ca2e4c2131 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:26.647876 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c10459e4-4093-4530-97a5-62ca2e4c2131 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:26.648506 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c10459e4-4093-4530-97a5-62ca2e4c2131 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:26.649387 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c10459e4-4093-4530-97a5-62ca2e4c2131 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:26.650374 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c10459e4-4093-4530-97a5-62ca2e4c2131 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:26.650841 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c10459e4-4093-4530-97a5-62ca2e4c2131 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:26.651837 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c10459e4-4093-4530-97a5-62ca2e4c2131 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:26.829991 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-c10459e4-4093-4530-97a5-62ca2e4c2131 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:26.833490 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:51:26.839704 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-c10459e4-4093-4530-97a5-62ca2e4c2131 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:26.841144 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-c10459e4-4093-4530-97a5-62ca2e4c2131 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:26.842306 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-c10459e4-4093-4530-97a5-62ca2e4c2131 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1723 microversion: 2.20 time: 0.214775 Sep 03 03:51:26.844509 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 201/398] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:26 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:51:26.976773 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-01d32b02-ebd8-419c-bb46-79bd92b69bc8 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:26.977792 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-01d32b02-ebd8-419c-bb46-79bd92b69bc8 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: f23f06ef-2db1-4e7b-a2f4-71927f83b40d] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:26.986403 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-01d32b02-ebd8-419c-bb46-79bd92b69bc8 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:26.987067 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-01d32b02-ebd8-419c-bb46-79bd92b69bc8 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:26.987584 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-01d32b02-ebd8-419c-bb46-79bd92b69bc8 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:26.988740 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-01d32b02-ebd8-419c-bb46-79bd92b69bc8 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:26.989443 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-01d32b02-ebd8-419c-bb46-79bd92b69bc8 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:26.990055 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-01d32b02-ebd8-419c-bb46-79bd92b69bc8 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:27.203154 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-11047f41-91b9-42df-88cb-8cb08a5b8503 req-ff88c2df-3156-4db1-b0b9-236232e2b6a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f5b827b-0905-4360-b0b5-f5881a029bc2", "tag": "9f1ab985-1982-45d9-b595-93496be6d12f"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:51:27.219044 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-11047f41-91b9-42df-88cb-8cb08a5b8503 req-ff88c2df-3156-4db1-b0b9-236232e2b6a2 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:27.219797 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-11047f41-91b9-42df-88cb-8cb08a5b8503 req-ff88c2df-3156-4db1-b0b9-236232e2b6a2 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:27.220920 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-11047f41-91b9-42df-88cb-8cb08a5b8503 req-ff88c2df-3156-4db1-b0b9-236232e2b6a2 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:27.234253 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-01d32b02-ebd8-419c-bb46-79bd92b69bc8 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:27.248171 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-11047f41-91b9-42df-88cb-8cb08a5b8503 req-ff88c2df-3156-4db1-b0b9-236232e2b6a2 service nova] Creating event network-changed:9f1ab985-1982-45d9-b595-93496be6d12f for instance 4f5b827b-0905-4360-b0b5-f5881a029bc2 on hv-cinder-79966 Sep 03 03:51:27.260502 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-01d32b02-ebd8-419c-bb46-79bd92b69bc8 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d" status: 200 len: 1366 microversion: 2.1 time: 0.289805 Sep 03 03:51:27.270879 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 198/399] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:26 2022] GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d => generated 1366 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:27.281238 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-11047f41-91b9-42df-88cb-8cb08a5b8503 req-ff88c2df-3156-4db1-b0b9-236232e2b6a2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073096 Sep 03 03:51:27.282380 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 202/400] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:51:27.434367 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-cbaf9a79-dbb0-414d-8840-f47e28ecad48 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:27.437162 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-cbaf9a79-dbb0-414d-8840-f47e28ecad48 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:27.447770 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cbaf9a79-dbb0-414d-8840-f47e28ecad48 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:27.448595 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cbaf9a79-dbb0-414d-8840-f47e28ecad48 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:27.449215 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cbaf9a79-dbb0-414d-8840-f47e28ecad48 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:27.450902 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cbaf9a79-dbb0-414d-8840-f47e28ecad48 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:27.452033 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cbaf9a79-dbb0-414d-8840-f47e28ecad48 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:27.452838 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cbaf9a79-dbb0-414d-8840-f47e28ecad48 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:27.670281 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-cbaf9a79-dbb0-414d-8840-f47e28ecad48 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:27.680922 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-cbaf9a79-dbb0-414d-8840-f47e28ecad48 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1724 microversion: 2.1 time: 0.251301 Sep 03 03:51:27.695748 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 199/401] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:27 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1724 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:27.883620 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-9ffa2fde-8a85-45f2-83da-3f232b74eb4d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:27.885177 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-9ffa2fde-8a85-45f2-83da-3f232b74eb4d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:27.905650 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9ffa2fde-8a85-45f2-83da-3f232b74eb4d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:27.907010 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9ffa2fde-8a85-45f2-83da-3f232b74eb4d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:27.907493 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9ffa2fde-8a85-45f2-83da-3f232b74eb4d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:27.908567 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9ffa2fde-8a85-45f2-83da-3f232b74eb4d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:27.909031 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9ffa2fde-8a85-45f2-83da-3f232b74eb4d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:27.909454 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9ffa2fde-8a85-45f2-83da-3f232b74eb4d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:28.104459 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-9ffa2fde-8a85-45f2-83da-3f232b74eb4d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:28.118127 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-9ffa2fde-8a85-45f2-83da-3f232b74eb4d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:28.120463 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-9ffa2fde-8a85-45f2-83da-3f232b74eb4d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:28.122047 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-9ffa2fde-8a85-45f2-83da-3f232b74eb4d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1723 microversion: 2.20 time: 0.251927 Sep 03 03:51:28.135604 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 203/402] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:27 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1723 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:51:28.291507 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-9209a9c7-1d99-4dc6-afdc-acff52cab28d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:28.292386 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-9209a9c7-1d99-4dc6-afdc-acff52cab28d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: f23f06ef-2db1-4e7b-a2f4-71927f83b40d] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:28.295260 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=1 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:51:28.305578 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9209a9c7-1d99-4dc6-afdc-acff52cab28d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:28.306181 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9209a9c7-1d99-4dc6-afdc-acff52cab28d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:28.309063 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9209a9c7-1d99-4dc6-afdc-acff52cab28d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:28.309911 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9209a9c7-1d99-4dc6-afdc-acff52cab28d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:28.310442 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9209a9c7-1d99-4dc6-afdc-acff52cab28d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:28.314157 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9209a9c7-1d99-4dc6-afdc-acff52cab28d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:28.505649 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-9209a9c7-1d99-4dc6-afdc-acff52cab28d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:28.513849 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-9209a9c7-1d99-4dc6-afdc-acff52cab28d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d" status: 200 len: 1366 microversion: 2.1 time: 0.227911 Sep 03 03:51:28.514517 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 200/403] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:28 2022] GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:28.705744 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-6fbe1d0c-2f56-4c2d-965f-8d796d484599 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:28.706472 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-6fbe1d0c-2f56-4c2d-965f-8d796d484599 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:28.713591 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6fbe1d0c-2f56-4c2d-965f-8d796d484599 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:28.714348 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6fbe1d0c-2f56-4c2d-965f-8d796d484599 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:28.714978 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6fbe1d0c-2f56-4c2d-965f-8d796d484599 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:28.715885 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6fbe1d0c-2f56-4c2d-965f-8d796d484599 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:28.716300 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6fbe1d0c-2f56-4c2d-965f-8d796d484599 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:28.716907 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6fbe1d0c-2f56-4c2d-965f-8d796d484599 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:28.882775 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-6fbe1d0c-2f56-4c2d-965f-8d796d484599 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:28.892005 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-6fbe1d0c-2f56-4c2d-965f-8d796d484599 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1724 microversion: 2.1 time: 0.190234 Sep 03 03:51:28.907530 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 204/404] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:28 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:29.154697 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-a1631d61-1824-4bc5-ad8c-3b323dc8bbb6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:29.155427 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-a1631d61-1824-4bc5-ad8c-3b323dc8bbb6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:29.162084 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a1631d61-1824-4bc5-ad8c-3b323dc8bbb6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:29.162821 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a1631d61-1824-4bc5-ad8c-3b323dc8bbb6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:29.163251 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a1631d61-1824-4bc5-ad8c-3b323dc8bbb6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:29.163943 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a1631d61-1824-4bc5-ad8c-3b323dc8bbb6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:29.164567 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a1631d61-1824-4bc5-ad8c-3b323dc8bbb6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:29.165202 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a1631d61-1824-4bc5-ad8c-3b323dc8bbb6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:29.357772 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a1631d61-1824-4bc5-ad8c-3b323dc8bbb6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:29.369028 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a1631d61-1824-4bc5-ad8c-3b323dc8bbb6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:29.370450 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a1631d61-1824-4bc5-ad8c-3b323dc8bbb6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:29.371658 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-a1631d61-1824-4bc5-ad8c-3b323dc8bbb6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1744 microversion: 2.20 time: 0.221728 Sep 03 03:51:29.375198 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 201/405] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:29 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1744 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:51:29.540844 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-f33775c9-e0dc-4d0b-9a94-d9088d99bbac tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:29.541435 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-f33775c9-e0dc-4d0b-9a94-d9088d99bbac tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: f23f06ef-2db1-4e7b-a2f4-71927f83b40d] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:29.548041 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f33775c9-e0dc-4d0b-9a94-d9088d99bbac tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:29.548562 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f33775c9-e0dc-4d0b-9a94-d9088d99bbac tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:29.549035 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f33775c9-e0dc-4d0b-9a94-d9088d99bbac tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:29.549738 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f33775c9-e0dc-4d0b-9a94-d9088d99bbac tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:29.550186 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f33775c9-e0dc-4d0b-9a94-d9088d99bbac tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:29.550601 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f33775c9-e0dc-4d0b-9a94-d9088d99bbac tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:29.693186 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-f33775c9-e0dc-4d0b-9a94-d9088d99bbac tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:29.708378 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-f33775c9-e0dc-4d0b-9a94-d9088d99bbac tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d" status: 200 len: 1366 microversion: 2.1 time: 0.171712 Sep 03 03:51:29.715187 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 205/406] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:29 2022] GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:29.919633 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-bbbe1c02-3952-4bd7-94d2-79e906e40466 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:29.920470 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-bbbe1c02-3952-4bd7-94d2-79e906e40466 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:29.929183 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bbbe1c02-3952-4bd7-94d2-79e906e40466 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:29.929866 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bbbe1c02-3952-4bd7-94d2-79e906e40466 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:29.930477 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bbbe1c02-3952-4bd7-94d2-79e906e40466 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:29.931494 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bbbe1c02-3952-4bd7-94d2-79e906e40466 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:29.932138 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bbbe1c02-3952-4bd7-94d2-79e906e40466 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:29.932728 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bbbe1c02-3952-4bd7-94d2-79e906e40466 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:30.066457 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-bbbe1c02-3952-4bd7-94d2-79e906e40466 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:30.075463 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-bbbe1c02-3952-4bd7-94d2-79e906e40466 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1724 microversion: 2.1 time: 0.161608 Sep 03 03:51:30.076061 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 202/407] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:29 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:30.402111 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-0fbed95d-a840-447e-859b-f557cda06547 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:30.402997 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-0fbed95d-a840-447e-859b-f557cda06547 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:30.413475 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0fbed95d-a840-447e-859b-f557cda06547 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:30.413998 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0fbed95d-a840-447e-859b-f557cda06547 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:30.414398 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0fbed95d-a840-447e-859b-f557cda06547 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:30.415130 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0fbed95d-a840-447e-859b-f557cda06547 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:30.415571 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0fbed95d-a840-447e-859b-f557cda06547 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:30.416164 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0fbed95d-a840-447e-859b-f557cda06547 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:30.549015 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-0fbed95d-a840-447e-859b-f557cda06547 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:30.557263 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-0fbed95d-a840-447e-859b-f557cda06547 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:30.558693 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-0fbed95d-a840-447e-859b-f557cda06547 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:30.559865 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-0fbed95d-a840-447e-859b-f557cda06547 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1744 microversion: 2.20 time: 0.164767 Sep 03 03:51:30.560603 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 206/408] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:30 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:51:30.737695 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-7b12354d-232e-4b4e-b914-b10f9eb4b67d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:30.738679 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-7b12354d-232e-4b4e-b914-b10f9eb4b67d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: f23f06ef-2db1-4e7b-a2f4-71927f83b40d] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:30.745191 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7b12354d-232e-4b4e-b914-b10f9eb4b67d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:30.745884 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7b12354d-232e-4b4e-b914-b10f9eb4b67d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:30.746474 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7b12354d-232e-4b4e-b914-b10f9eb4b67d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:30.747379 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7b12354d-232e-4b4e-b914-b10f9eb4b67d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:30.747994 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7b12354d-232e-4b4e-b914-b10f9eb4b67d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:30.748560 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7b12354d-232e-4b4e-b914-b10f9eb4b67d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:30.898461 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-7b12354d-232e-4b4e-b914-b10f9eb4b67d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:30.906997 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-7b12354d-232e-4b4e-b914-b10f9eb4b67d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d" status: 200 len: 1366 microversion: 2.1 time: 0.173701 Sep 03 03:51:30.907555 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 203/409] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:30 2022] GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:31.099007 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-4d07eed5-c44d-4b6d-bca5-47d4a062e40b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:31.099824 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-4d07eed5-c44d-4b6d-bca5-47d4a062e40b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:31.106503 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4d07eed5-c44d-4b6d-bca5-47d4a062e40b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:31.107339 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4d07eed5-c44d-4b6d-bca5-47d4a062e40b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:31.107777 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4d07eed5-c44d-4b6d-bca5-47d4a062e40b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:31.108911 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4d07eed5-c44d-4b6d-bca5-47d4a062e40b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:31.108991 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4d07eed5-c44d-4b6d-bca5-47d4a062e40b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:31.109403 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4d07eed5-c44d-4b6d-bca5-47d4a062e40b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:31.262222 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-4d07eed5-c44d-4b6d-bca5-47d4a062e40b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:31.270560 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-4d07eed5-c44d-4b6d-bca5-47d4a062e40b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1724 microversion: 2.1 time: 0.175493 Sep 03 03:51:31.271157 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 207/410] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:31 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:31.585336 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-0c4f4fe2-4b5b-4fb6-9b6a-8b9116d3756c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:31.585884 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-0c4f4fe2-4b5b-4fb6-9b6a-8b9116d3756c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:31.592880 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0c4f4fe2-4b5b-4fb6-9b6a-8b9116d3756c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:31.593370 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0c4f4fe2-4b5b-4fb6-9b6a-8b9116d3756c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:31.593785 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0c4f4fe2-4b5b-4fb6-9b6a-8b9116d3756c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:31.594449 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0c4f4fe2-4b5b-4fb6-9b6a-8b9116d3756c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:31.594933 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0c4f4fe2-4b5b-4fb6-9b6a-8b9116d3756c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:31.595353 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0c4f4fe2-4b5b-4fb6-9b6a-8b9116d3756c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:31.734430 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-0c4f4fe2-4b5b-4fb6-9b6a-8b9116d3756c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:31.742951 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-0c4f4fe2-4b5b-4fb6-9b6a-8b9116d3756c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:31.744440 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-0c4f4fe2-4b5b-4fb6-9b6a-8b9116d3756c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:31.745593 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-0c4f4fe2-4b5b-4fb6-9b6a-8b9116d3756c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1744 microversion: 2.20 time: 0.164454 Sep 03 03:51:31.746205 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 204/411] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:31 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:51:31.929750 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-1d9a78c7-a393-41b0-8f48-3fbbb4ca56fa tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:31.930352 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-1d9a78c7-a393-41b0-8f48-3fbbb4ca56fa tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: f23f06ef-2db1-4e7b-a2f4-71927f83b40d] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:31.937298 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1d9a78c7-a393-41b0-8f48-3fbbb4ca56fa tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:31.937782 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1d9a78c7-a393-41b0-8f48-3fbbb4ca56fa tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:31.938212 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1d9a78c7-a393-41b0-8f48-3fbbb4ca56fa tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:31.938935 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1d9a78c7-a393-41b0-8f48-3fbbb4ca56fa tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:31.939386 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1d9a78c7-a393-41b0-8f48-3fbbb4ca56fa tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:31.939800 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1d9a78c7-a393-41b0-8f48-3fbbb4ca56fa tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:32.080670 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-1d9a78c7-a393-41b0-8f48-3fbbb4ca56fa tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:32.088858 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-1d9a78c7-a393-41b0-8f48-3fbbb4ca56fa tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d" status: 200 len: 1366 microversion: 2.1 time: 0.163013 Sep 03 03:51:32.089429 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 208/412] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:31 2022] GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:32.295198 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-84061b6f-e2c2-43cb-97ea-3ada7cd6e30c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:32.295852 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-84061b6f-e2c2-43cb-97ea-3ada7cd6e30c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:32.302642 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-84061b6f-e2c2-43cb-97ea-3ada7cd6e30c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:32.303178 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-84061b6f-e2c2-43cb-97ea-3ada7cd6e30c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:32.303612 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-84061b6f-e2c2-43cb-97ea-3ada7cd6e30c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:32.304300 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-84061b6f-e2c2-43cb-97ea-3ada7cd6e30c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:32.304720 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-84061b6f-e2c2-43cb-97ea-3ada7cd6e30c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:32.305161 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-84061b6f-e2c2-43cb-97ea-3ada7cd6e30c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:32.446404 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-84061b6f-e2c2-43cb-97ea-3ada7cd6e30c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:32.455195 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-84061b6f-e2c2-43cb-97ea-3ada7cd6e30c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1724 microversion: 2.1 time: 0.163888 Sep 03 03:51:32.455729 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 205/413] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:32 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:32.772987 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-7cb4386e-b623-4ab3-bf0e-a43a64aeb550 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:32.773580 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-7cb4386e-b623-4ab3-bf0e-a43a64aeb550 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:32.779691 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7cb4386e-b623-4ab3-bf0e-a43a64aeb550 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:32.780425 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7cb4386e-b623-4ab3-bf0e-a43a64aeb550 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:32.780819 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7cb4386e-b623-4ab3-bf0e-a43a64aeb550 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:32.781671 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7cb4386e-b623-4ab3-bf0e-a43a64aeb550 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:32.782305 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7cb4386e-b623-4ab3-bf0e-a43a64aeb550 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:32.782693 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7cb4386e-b623-4ab3-bf0e-a43a64aeb550 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:32.843622 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-cc04d3be-38b1-4e97-a333-645acf52d738 req-58ff33da-b43a-40af-af79-81eabe87300d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d61f1c-d865-4d0d-89a9-1f91f0f8bf78", "name": "network-vif-plugged", "status": "completed", "tag": "dc502e70-8b66-4849-929e-0879ed88e591"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:51:32.857454 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-cc04d3be-38b1-4e97-a333-645acf52d738 req-58ff33da-b43a-40af-af79-81eabe87300d service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:32.858421 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-cc04d3be-38b1-4e97-a333-645acf52d738 req-58ff33da-b43a-40af-af79-81eabe87300d service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:32.859132 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-cc04d3be-38b1-4e97-a333-645acf52d738 req-58ff33da-b43a-40af-af79-81eabe87300d service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:32.874463 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-cc04d3be-38b1-4e97-a333-645acf52d738 req-58ff33da-b43a-40af-af79-81eabe87300d service nova] Creating event network-vif-plugged:dc502e70-8b66-4849-929e-0879ed88e591 for instance 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 on hv-cinder-79966 Sep 03 03:51:32.880037 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-cc04d3be-38b1-4e97-a333-645acf52d738 req-58ff33da-b43a-40af-af79-81eabe87300d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040464 Sep 03 03:51:32.880754 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 206/414] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 03:51:33.022488 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-7cb4386e-b623-4ab3-bf0e-a43a64aeb550 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:33.030633 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-7cb4386e-b623-4ab3-bf0e-a43a64aeb550 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:33.032079 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-7cb4386e-b623-4ab3-bf0e-a43a64aeb550 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:33.033219 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-7cb4386e-b623-4ab3-bf0e-a43a64aeb550 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1744 microversion: 2.20 time: 0.264306 Sep 03 03:51:33.033767 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 209/415] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:32 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1744 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:51:33.112774 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-b42102db-f99a-417c-9a2c-f32ee2d48a3c tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:33.113482 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-b42102db-f99a-417c-9a2c-f32ee2d48a3c tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: f23f06ef-2db1-4e7b-a2f4-71927f83b40d] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:33.119888 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b42102db-f99a-417c-9a2c-f32ee2d48a3c tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:33.120352 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b42102db-f99a-417c-9a2c-f32ee2d48a3c tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:33.120778 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b42102db-f99a-417c-9a2c-f32ee2d48a3c tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:33.121498 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b42102db-f99a-417c-9a2c-f32ee2d48a3c tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:33.121943 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b42102db-f99a-417c-9a2c-f32ee2d48a3c tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:33.122359 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b42102db-f99a-417c-9a2c-f32ee2d48a3c tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:33.288724 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-b42102db-f99a-417c-9a2c-f32ee2d48a3c tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:33.302941 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-b42102db-f99a-417c-9a2c-f32ee2d48a3c tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d" status: 200 len: 1366 microversion: 2.1 time: 0.194521 Sep 03 03:51:33.303638 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 207/416] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:33 2022] GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:33.479352 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-8f136404-e6fa-45d2-a009-7345d48bc32d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:33.480067 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-8f136404-e6fa-45d2-a009-7345d48bc32d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:33.487545 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8f136404-e6fa-45d2-a009-7345d48bc32d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:33.488381 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8f136404-e6fa-45d2-a009-7345d48bc32d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:33.493312 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8f136404-e6fa-45d2-a009-7345d48bc32d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:33.496571 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8f136404-e6fa-45d2-a009-7345d48bc32d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:33.497209 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8f136404-e6fa-45d2-a009-7345d48bc32d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:33.497805 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8f136404-e6fa-45d2-a009-7345d48bc32d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:33.693445 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-8f136404-e6fa-45d2-a009-7345d48bc32d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:33.706782 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-8f136404-e6fa-45d2-a009-7345d48bc32d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1724 microversion: 2.1 time: 0.231330 Sep 03 03:51:33.707698 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 210/417] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:33 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:34.057551 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-c51c01b1-f9f6-4f5b-8b15-67d445b39af6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:34.058154 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-c51c01b1-f9f6-4f5b-8b15-67d445b39af6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:34.066394 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c51c01b1-f9f6-4f5b-8b15-67d445b39af6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:34.067420 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c51c01b1-f9f6-4f5b-8b15-67d445b39af6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:34.068669 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c51c01b1-f9f6-4f5b-8b15-67d445b39af6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:34.069777 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c51c01b1-f9f6-4f5b-8b15-67d445b39af6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:34.071134 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c51c01b1-f9f6-4f5b-8b15-67d445b39af6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:34.071914 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c51c01b1-f9f6-4f5b-8b15-67d445b39af6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:34.274567 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-c51c01b1-f9f6-4f5b-8b15-67d445b39af6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:34.288655 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-c51c01b1-f9f6-4f5b-8b15-67d445b39af6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:34.292511 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-c51c01b1-f9f6-4f5b-8b15-67d445b39af6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:34.293686 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-c51c01b1-f9f6-4f5b-8b15-67d445b39af6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1739 microversion: 2.20 time: 0.239989 Sep 03 03:51:34.294242 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 208/418] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:34 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1739 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:51:34.328423 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-92b922b7-a0ce-4623-badf-dc6021e8e512 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:34.329195 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-92b922b7-a0ce-4623-badf-dc6021e8e512 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: f23f06ef-2db1-4e7b-a2f4-71927f83b40d] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:34.347600 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-92b922b7-a0ce-4623-badf-dc6021e8e512 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:34.348060 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-92b922b7-a0ce-4623-badf-dc6021e8e512 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:34.348976 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-92b922b7-a0ce-4623-badf-dc6021e8e512 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:34.349988 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-92b922b7-a0ce-4623-badf-dc6021e8e512 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:34.350554 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-92b922b7-a0ce-4623-badf-dc6021e8e512 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:34.351007 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-92b922b7-a0ce-4623-badf-dc6021e8e512 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:34.557098 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-92b922b7-a0ce-4623-badf-dc6021e8e512 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:34.567520 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-92b922b7-a0ce-4623-badf-dc6021e8e512 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d" status: 200 len: 1366 microversion: 2.1 time: 0.244371 Sep 03 03:51:34.568680 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 211/419] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:34 2022] GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:34.731300 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-ccbf3130-c056-45d9-befd-118d27cd1acf tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:34.732809 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-ccbf3130-c056-45d9-befd-118d27cd1acf tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:34.739720 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ccbf3130-c056-45d9-befd-118d27cd1acf tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:34.740662 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ccbf3130-c056-45d9-befd-118d27cd1acf tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:34.741466 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ccbf3130-c056-45d9-befd-118d27cd1acf tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:34.742305 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ccbf3130-c056-45d9-befd-118d27cd1acf tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:34.743043 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ccbf3130-c056-45d9-befd-118d27cd1acf tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:34.743800 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ccbf3130-c056-45d9-befd-118d27cd1acf tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:34.898491 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-ccbf3130-c056-45d9-befd-118d27cd1acf tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:34.903904 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-46b7fbb0-7054-4f92-bddd-9a8352cdee4a req-dc1cc68d-f9cc-4d67-b1e5-674b09cdfc34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f23f06ef-2db1-4e7b-a2f4-71927f83b40d", "name": "network-vif-plugged", "status": "completed", "tag": "7375a989-9439-4258-b7ff-865576ed3c85"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:51:34.909960 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-ccbf3130-c056-45d9-befd-118d27cd1acf tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1724 microversion: 2.1 time: 0.182289 Sep 03 03:51:34.914214 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-46b7fbb0-7054-4f92-bddd-9a8352cdee4a req-dc1cc68d-f9cc-4d67-b1e5-674b09cdfc34 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:34.914694 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-46b7fbb0-7054-4f92-bddd-9a8352cdee4a req-dc1cc68d-f9cc-4d67-b1e5-674b09cdfc34 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:34.915146 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-46b7fbb0-7054-4f92-bddd-9a8352cdee4a req-dc1cc68d-f9cc-4d67-b1e5-674b09cdfc34 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:34.920161 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 209/420] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:34 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:34.926688 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-46b7fbb0-7054-4f92-bddd-9a8352cdee4a req-dc1cc68d-f9cc-4d67-b1e5-674b09cdfc34 service nova] Creating event network-vif-plugged:7375a989-9439-4258-b7ff-865576ed3c85 for instance f23f06ef-2db1-4e7b-a2f4-71927f83b40d on hv-cinder-79966 Sep 03 03:51:34.932155 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-46b7fbb0-7054-4f92-bddd-9a8352cdee4a req-dc1cc68d-f9cc-4d67-b1e5-674b09cdfc34 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031875 Sep 03 03:51:34.932801 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 212/421] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 03:51:35.319758 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-35606a95-b4e0-4109-8b7d-28e60c7838f1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:35.321194 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-35606a95-b4e0-4109-8b7d-28e60c7838f1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:35.332904 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-35606a95-b4e0-4109-8b7d-28e60c7838f1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:35.333542 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-35606a95-b4e0-4109-8b7d-28e60c7838f1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:35.334115 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-35606a95-b4e0-4109-8b7d-28e60c7838f1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:35.334974 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-35606a95-b4e0-4109-8b7d-28e60c7838f1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:35.335551 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-35606a95-b4e0-4109-8b7d-28e60c7838f1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:35.336124 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-35606a95-b4e0-4109-8b7d-28e60c7838f1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:35.502089 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-35606a95-b4e0-4109-8b7d-28e60c7838f1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:35.511533 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-35606a95-b4e0-4109-8b7d-28e60c7838f1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:35.513044 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-35606a95-b4e0-4109-8b7d-28e60c7838f1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:35.516798 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-35606a95-b4e0-4109-8b7d-28e60c7838f1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1739 microversion: 2.20 time: 0.200725 Sep 03 03:51:35.517731 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 210/422] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:35 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:51:35.595115 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-cac15280-dc6f-4f91-87c4-84ff26c2533d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:35.596426 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-cac15280-dc6f-4f91-87c4-84ff26c2533d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: f23f06ef-2db1-4e7b-a2f4-71927f83b40d] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:35.603302 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cac15280-dc6f-4f91-87c4-84ff26c2533d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:35.604006 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cac15280-dc6f-4f91-87c4-84ff26c2533d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:35.604581 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cac15280-dc6f-4f91-87c4-84ff26c2533d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:35.605516 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cac15280-dc6f-4f91-87c4-84ff26c2533d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:35.606102 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cac15280-dc6f-4f91-87c4-84ff26c2533d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:35.606701 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cac15280-dc6f-4f91-87c4-84ff26c2533d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:35.761868 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-cac15280-dc6f-4f91-87c4-84ff26c2533d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:35.770549 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-cac15280-dc6f-4f91-87c4-84ff26c2533d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d" status: 200 len: 1366 microversion: 2.1 time: 0.179597 Sep 03 03:51:35.771518 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 213/423] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:35 2022] GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:35.933689 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-eda99f00-903a-43bb-96db-b618e4a3c49e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:35.934655 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-eda99f00-903a-43bb-96db-b618e4a3c49e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:35.941093 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eda99f00-903a-43bb-96db-b618e4a3c49e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:35.941779 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eda99f00-903a-43bb-96db-b618e4a3c49e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:35.942460 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eda99f00-903a-43bb-96db-b618e4a3c49e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:35.943462 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eda99f00-903a-43bb-96db-b618e4a3c49e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:35.943981 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eda99f00-903a-43bb-96db-b618e4a3c49e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:35.944384 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eda99f00-903a-43bb-96db-b618e4a3c49e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:36.097361 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-eda99f00-903a-43bb-96db-b618e4a3c49e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:36.109847 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-eda99f00-903a-43bb-96db-b618e4a3c49e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1724 microversion: 2.1 time: 0.179953 Sep 03 03:51:36.110763 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 211/424] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:35 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:36.542888 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-33cc1ab3-aebc-4fca-95f6-5b58b0c3eacc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:36.543895 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-33cc1ab3-aebc-4fca-95f6-5b58b0c3eacc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:36.552749 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-33cc1ab3-aebc-4fca-95f6-5b58b0c3eacc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:36.553642 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-33cc1ab3-aebc-4fca-95f6-5b58b0c3eacc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:36.555569 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-33cc1ab3-aebc-4fca-95f6-5b58b0c3eacc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:36.556555 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-33cc1ab3-aebc-4fca-95f6-5b58b0c3eacc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:36.557309 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-33cc1ab3-aebc-4fca-95f6-5b58b0c3eacc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:36.557971 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-33cc1ab3-aebc-4fca-95f6-5b58b0c3eacc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:36.752804 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-33cc1ab3-aebc-4fca-95f6-5b58b0c3eacc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:36.762903 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-33cc1ab3-aebc-4fca-95f6-5b58b0c3eacc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:36.764488 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-33cc1ab3-aebc-4fca-95f6-5b58b0c3eacc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:36.766062 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-33cc1ab3-aebc-4fca-95f6-5b58b0c3eacc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1739 microversion: 2.20 time: 0.227587 Sep 03 03:51:36.766482 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 214/425] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:36 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:51:36.794329 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-96094fd2-7494-4c78-90b6-f9353f2aa4e5 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:36.795077 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-96094fd2-7494-4c78-90b6-f9353f2aa4e5 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: f23f06ef-2db1-4e7b-a2f4-71927f83b40d] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:36.802666 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-96094fd2-7494-4c78-90b6-f9353f2aa4e5 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:36.803340 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-96094fd2-7494-4c78-90b6-f9353f2aa4e5 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:36.804012 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-96094fd2-7494-4c78-90b6-f9353f2aa4e5 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:36.805019 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-96094fd2-7494-4c78-90b6-f9353f2aa4e5 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:36.806004 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-96094fd2-7494-4c78-90b6-f9353f2aa4e5 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:36.806581 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-96094fd2-7494-4c78-90b6-f9353f2aa4e5 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:37.059853 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-96094fd2-7494-4c78-90b6-f9353f2aa4e5 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:37.068881 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-96094fd2-7494-4c78-90b6-f9353f2aa4e5 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d" status: 200 len: 1366 microversion: 2.1 time: 0.278990 Sep 03 03:51:37.069486 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 212/426] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:36 2022] GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:37.133931 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-8d0f82d8-ffd1-4a2c-8efd-7bd03a78fa15 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:37.135188 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-8d0f82d8-ffd1-4a2c-8efd-7bd03a78fa15 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:37.141874 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8d0f82d8-ffd1-4a2c-8efd-7bd03a78fa15 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:37.142628 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8d0f82d8-ffd1-4a2c-8efd-7bd03a78fa15 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:37.143088 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8d0f82d8-ffd1-4a2c-8efd-7bd03a78fa15 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:37.143810 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8d0f82d8-ffd1-4a2c-8efd-7bd03a78fa15 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:37.144256 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8d0f82d8-ffd1-4a2c-8efd-7bd03a78fa15 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:37.144858 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8d0f82d8-ffd1-4a2c-8efd-7bd03a78fa15 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:37.314990 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-8d0f82d8-ffd1-4a2c-8efd-7bd03a78fa15 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:37.324086 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-8d0f82d8-ffd1-4a2c-8efd-7bd03a78fa15 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1724 microversion: 2.1 time: 0.194300 Sep 03 03:51:37.324660 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 215/427] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:37 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:37.795607 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-9a0b817e-0f8f-4f7b-9907-f7983a4c6aa9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:37.796867 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-9a0b817e-0f8f-4f7b-9907-f7983a4c6aa9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:37.805518 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9a0b817e-0f8f-4f7b-9907-f7983a4c6aa9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:37.806513 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9a0b817e-0f8f-4f7b-9907-f7983a4c6aa9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:37.806965 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9a0b817e-0f8f-4f7b-9907-f7983a4c6aa9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:37.810119 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9a0b817e-0f8f-4f7b-9907-f7983a4c6aa9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:37.811734 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9a0b817e-0f8f-4f7b-9907-f7983a4c6aa9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:37.812871 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9a0b817e-0f8f-4f7b-9907-f7983a4c6aa9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:37.971746 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-9a0b817e-0f8f-4f7b-9907-f7983a4c6aa9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:37.999902 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-9a0b817e-0f8f-4f7b-9907-f7983a4c6aa9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:38.002585 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-9a0b817e-0f8f-4f7b-9907-f7983a4c6aa9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:38.006428 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-9a0b817e-0f8f-4f7b-9907-f7983a4c6aa9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1739 microversion: 2.20 time: 0.219810 Sep 03 03:51:38.009064 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 213/428] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:37 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1739 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:51:38.092062 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-025fbcfe-8ee9-4316-ae82-24ae122e827a tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:38.092968 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-025fbcfe-8ee9-4316-ae82-24ae122e827a tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: f23f06ef-2db1-4e7b-a2f4-71927f83b40d] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:38.099362 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-025fbcfe-8ee9-4316-ae82-24ae122e827a tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:38.100038 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-025fbcfe-8ee9-4316-ae82-24ae122e827a tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:38.100645 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-025fbcfe-8ee9-4316-ae82-24ae122e827a tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:38.101682 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-025fbcfe-8ee9-4316-ae82-24ae122e827a tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:38.102559 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-025fbcfe-8ee9-4316-ae82-24ae122e827a tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:38.103281 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-025fbcfe-8ee9-4316-ae82-24ae122e827a tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:38.269691 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-025fbcfe-8ee9-4316-ae82-24ae122e827a tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:38.281877 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-025fbcfe-8ee9-4316-ae82-24ae122e827a tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d" status: 200 len: 1556 microversion: 2.1 time: 0.194136 Sep 03 03:51:38.310317 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-e84b2017-ea04-40ac-8cbe-0eb3ec4558cb tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:38.310997 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-e84b2017-ea04-40ac-8cbe-0eb3ec4558cb tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: f23f06ef-2db1-4e7b-a2f4-71927f83b40d] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:38.315649 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 216/429] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:38 2022] GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d => generated 1556 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:38.328597 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e84b2017-ea04-40ac-8cbe-0eb3ec4558cb tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:38.329602 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e84b2017-ea04-40ac-8cbe-0eb3ec4558cb tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:38.330132 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e84b2017-ea04-40ac-8cbe-0eb3ec4558cb tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:38.333398 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e84b2017-ea04-40ac-8cbe-0eb3ec4558cb tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:38.333953 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e84b2017-ea04-40ac-8cbe-0eb3ec4558cb tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:38.334695 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e84b2017-ea04-40ac-8cbe-0eb3ec4558cb tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:38.350841 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-1e8a3659-4355-4c3a-9d7a-137f4056a2a9 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:38.351678 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-1e8a3659-4355-4c3a-9d7a-137f4056a2a9 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:38.361082 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1e8a3659-4355-4c3a-9d7a-137f4056a2a9 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:38.362591 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1e8a3659-4355-4c3a-9d7a-137f4056a2a9 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:38.363264 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1e8a3659-4355-4c3a-9d7a-137f4056a2a9 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:38.364232 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1e8a3659-4355-4c3a-9d7a-137f4056a2a9 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:38.365010 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1e8a3659-4355-4c3a-9d7a-137f4056a2a9 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:38.365899 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1e8a3659-4355-4c3a-9d7a-137f4056a2a9 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:38.483726 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-e84b2017-ea04-40ac-8cbe-0eb3ec4558cb tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.177347 Sep 03 03:51:38.485157 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 214/430] 10.222.0.25 () {58 vars in 1275 bytes} [Sat Sep 3 03:51:38 2022] GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d/os-interface => generated 285 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:51:38.671558 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-1e8a3659-4355-4c3a-9d7a-137f4056a2a9 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:38.681513 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-1e8a3659-4355-4c3a-9d7a-137f4056a2a9 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1724 microversion: 2.1 time: 0.335694 Sep 03 03:51:38.682915 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 217/431] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:38 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1724 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:39.039057 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-7fabe5b5-0fe5-481c-b47e-f2f6b1152722 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:39.040270 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-7fabe5b5-0fe5-481c-b47e-f2f6b1152722 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:39.048831 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7fabe5b5-0fe5-481c-b47e-f2f6b1152722 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:39.049416 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7fabe5b5-0fe5-481c-b47e-f2f6b1152722 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:39.049903 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7fabe5b5-0fe5-481c-b47e-f2f6b1152722 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:39.051049 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7fabe5b5-0fe5-481c-b47e-f2f6b1152722 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:39.051923 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7fabe5b5-0fe5-481c-b47e-f2f6b1152722 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:39.052810 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7fabe5b5-0fe5-481c-b47e-f2f6b1152722 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:39.083479 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell1:SELECT=100 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:51:39.224744 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-7fabe5b5-0fe5-481c-b47e-f2f6b1152722 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:39.239951 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-7fabe5b5-0fe5-481c-b47e-f2f6b1152722 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:39.241364 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-7fabe5b5-0fe5-481c-b47e-f2f6b1152722 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:39.242512 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-7fabe5b5-0fe5-481c-b47e-f2f6b1152722 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1739 microversion: 2.20 time: 0.210871 Sep 03 03:51:39.249822 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 215/432] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:39 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:51:39.468989 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-2e7b4127-9c8d-49e0-ae6f-445f64cb9a52 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dcafb92e-2915-4d59-95b6-3e84b8330ffc", "device": "/dev/sdb"}} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:51:39.472914 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-2e7b4127-9c8d-49e0-ae6f-445f64cb9a52 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 12cfe47d-e76d-4318-b163-eacbda0af541] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:39.480412 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2e7b4127-9c8d-49e0-ae6f-445f64cb9a52 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:39.481080 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2e7b4127-9c8d-49e0-ae6f-445f64cb9a52 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:39.481671 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2e7b4127-9c8d-49e0-ae6f-445f64cb9a52 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:39.483017 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2e7b4127-9c8d-49e0-ae6f-445f64cb9a52 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:39.483632 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2e7b4127-9c8d-49e0-ae6f-445f64cb9a52 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:39.484328 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2e7b4127-9c8d-49e0-ae6f-445f64cb9a52 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:39.718924 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-0012c602-d22f-4242-aa89-af3943a79c1d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:39.719532 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-0012c602-d22f-4242-aa89-af3943a79c1d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:39.730039 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0012c602-d22f-4242-aa89-af3943a79c1d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:39.730563 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0012c602-d22f-4242-aa89-af3943a79c1d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:39.731031 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0012c602-d22f-4242-aa89-af3943a79c1d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:39.731756 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0012c602-d22f-4242-aa89-af3943a79c1d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:39.732905 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0012c602-d22f-4242-aa89-af3943a79c1d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:39.733334 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0012c602-d22f-4242-aa89-af3943a79c1d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:39.895277 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:51:39.911847 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-2e7b4127-9c8d-49e0-ae6f-445f64cb9a52 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "POST /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.448200 Sep 03 03:51:39.918980 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 218/433] 10.222.0.25 () {60 vars in 1323 bytes} [Sat Sep 3 03:51:39 2022] POST /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541/os-volume_attachments => generated 194 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:51:40.091559 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-1445faf7-a05a-46fa-84d6-4ff2db675b64 req-ffab5ff9-c2cd-4a46-af7b-5ea26cb1fa98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f23f06ef-2db1-4e7b-a2f4-71927f83b40d", "tag": "7375a989-9439-4258-b7ff-865576ed3c85"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:51:40.100114 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-0012c602-d22f-4242-aa89-af3943a79c1d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:40.113567 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-0012c602-d22f-4242-aa89-af3943a79c1d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1724 microversion: 2.1 time: 0.399694 Sep 03 03:51:40.123371 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-1445faf7-a05a-46fa-84d6-4ff2db675b64 req-ffab5ff9-c2cd-4a46-af7b-5ea26cb1fa98 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:40.123851 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-1445faf7-a05a-46fa-84d6-4ff2db675b64 req-ffab5ff9-c2cd-4a46-af7b-5ea26cb1fa98 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:40.124276 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-1445faf7-a05a-46fa-84d6-4ff2db675b64 req-ffab5ff9-c2cd-4a46-af7b-5ea26cb1fa98 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:40.127170 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 216/434] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:39 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1724 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:51:40.156370 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-1445faf7-a05a-46fa-84d6-4ff2db675b64 req-ffab5ff9-c2cd-4a46-af7b-5ea26cb1fa98 service nova] Creating event network-changed:7375a989-9439-4258-b7ff-865576ed3c85 for instance f23f06ef-2db1-4e7b-a2f4-71927f83b40d on hv-cinder-79966 Sep 03 03:51:40.163540 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-1445faf7-a05a-46fa-84d6-4ff2db675b64 req-ffab5ff9-c2cd-4a46-af7b-5ea26cb1fa98 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074425 Sep 03 03:51:40.164469 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 219/435] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:51:40.276579 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-9f226c46-cbbc-4106-a94a-fb04e8795b50 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:40.277349 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-9f226c46-cbbc-4106-a94a-fb04e8795b50 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:40.288400 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9f226c46-cbbc-4106-a94a-fb04e8795b50 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:40.289120 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9f226c46-cbbc-4106-a94a-fb04e8795b50 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:40.289709 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9f226c46-cbbc-4106-a94a-fb04e8795b50 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:40.290588 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9f226c46-cbbc-4106-a94a-fb04e8795b50 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:40.295251 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9f226c46-cbbc-4106-a94a-fb04e8795b50 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:40.295892 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9f226c46-cbbc-4106-a94a-fb04e8795b50 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:40.544609 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-9f226c46-cbbc-4106-a94a-fb04e8795b50 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:40.561433 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-9f226c46-cbbc-4106-a94a-fb04e8795b50 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:40.567162 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-9f226c46-cbbc-4106-a94a-fb04e8795b50 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:40.570208 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-9f226c46-cbbc-4106-a94a-fb04e8795b50 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1739 microversion: 2.20 time: 0.298143 Sep 03 03:51:40.579566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 217/436] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:40 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1739 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:51:41.141928 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-384f8d0e-6286-49c7-8644-0750aa6de21f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:41.143369 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-384f8d0e-6286-49c7-8644-0750aa6de21f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:41.166251 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-384f8d0e-6286-49c7-8644-0750aa6de21f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:41.166932 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-384f8d0e-6286-49c7-8644-0750aa6de21f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:41.167377 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-384f8d0e-6286-49c7-8644-0750aa6de21f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:41.168120 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-384f8d0e-6286-49c7-8644-0750aa6de21f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:41.168569 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-384f8d0e-6286-49c7-8644-0750aa6de21f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:41.168992 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-384f8d0e-6286-49c7-8644-0750aa6de21f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:41.378017 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-384f8d0e-6286-49c7-8644-0750aa6de21f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:41.388734 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-384f8d0e-6286-49c7-8644-0750aa6de21f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1724 microversion: 2.1 time: 0.251693 Sep 03 03:51:41.399216 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 220/437] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:41 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:41.610131 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-94b49f34-7f17-48e8-8192-aa203402c744 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:41.610727 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-94b49f34-7f17-48e8-8192-aa203402c744 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:41.623953 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-94b49f34-7f17-48e8-8192-aa203402c744 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:41.624706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-94b49f34-7f17-48e8-8192-aa203402c744 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:41.625298 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-94b49f34-7f17-48e8-8192-aa203402c744 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:41.628127 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-94b49f34-7f17-48e8-8192-aa203402c744 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:41.628733 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-94b49f34-7f17-48e8-8192-aa203402c744 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:41.629322 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-94b49f34-7f17-48e8-8192-aa203402c744 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:41.851202 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-94b49f34-7f17-48e8-8192-aa203402c744 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:41.860339 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-94b49f34-7f17-48e8-8192-aa203402c744 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:41.862236 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-94b49f34-7f17-48e8-8192-aa203402c744 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:41.869467 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-94b49f34-7f17-48e8-8192-aa203402c744 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1739 microversion: 2.20 time: 0.264361 Sep 03 03:51:41.882167 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 218/438] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:41 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1739 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:51:42.417374 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-9ce9ee07-e8a4-4109-bd66-8985693fb385 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:42.420016 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-9ce9ee07-e8a4-4109-bd66-8985693fb385 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:42.430216 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9ce9ee07-e8a4-4109-bd66-8985693fb385 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:42.431060 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9ce9ee07-e8a4-4109-bd66-8985693fb385 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:42.431746 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9ce9ee07-e8a4-4109-bd66-8985693fb385 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:42.432643 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9ce9ee07-e8a4-4109-bd66-8985693fb385 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:42.433317 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9ce9ee07-e8a4-4109-bd66-8985693fb385 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:42.434081 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9ce9ee07-e8a4-4109-bd66-8985693fb385 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:42.582410 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-9ce9ee07-e8a4-4109-bd66-8985693fb385 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:42.595936 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-9ce9ee07-e8a4-4109-bd66-8985693fb385 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1701 microversion: 2.1 time: 0.181382 Sep 03 03:51:42.598080 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 221/439] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:42 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1701 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:42.629161 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-987f8a80-091b-421f-b934-9668fbb75576 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:51:42.638186 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-987f8a80-091b-421f-b934-9668fbb75576 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:42.638976 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-987f8a80-091b-421f-b934-9668fbb75576 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:42.639642 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-987f8a80-091b-421f-b934-9668fbb75576 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:42.718055 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-987f8a80-091b-421f-b934-9668fbb75576 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Going to try to start instance {{(pid=132077) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 03 03:51:42.787721 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-987f8a80-091b-421f-b934-9668fbb75576 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "POST /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731/action" status: 202 len: 0 microversion: 2.1 time: 0.162496 Sep 03 03:51:42.790849 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 219/440] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Sep 3 03:51:42 2022] POST /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 03:51:42.801440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-171828a9-1104-4c5b-a710-07f3f3b1f45e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:42.804341 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-171828a9-1104-4c5b-a710-07f3f3b1f45e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:42.822143 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-171828a9-1104-4c5b-a710-07f3f3b1f45e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:42.823276 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-171828a9-1104-4c5b-a710-07f3f3b1f45e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:42.823916 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-171828a9-1104-4c5b-a710-07f3f3b1f45e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:42.824875 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-171828a9-1104-4c5b-a710-07f3f3b1f45e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:42.825530 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-171828a9-1104-4c5b-a710-07f3f3b1f45e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:42.826154 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-171828a9-1104-4c5b-a710-07f3f3b1f45e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:42.902097 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-4e5cab2b-873b-40cf-8652-3935a7f66894 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:42.902784 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-4e5cab2b-873b-40cf-8652-3935a7f66894 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:42.928358 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4e5cab2b-873b-40cf-8652-3935a7f66894 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:42.931432 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4e5cab2b-873b-40cf-8652-3935a7f66894 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:42.931880 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4e5cab2b-873b-40cf-8652-3935a7f66894 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:42.932642 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4e5cab2b-873b-40cf-8652-3935a7f66894 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:42.933053 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4e5cab2b-873b-40cf-8652-3935a7f66894 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:42.933474 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4e5cab2b-873b-40cf-8652-3935a7f66894 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:43.123629 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-4e5cab2b-873b-40cf-8652-3935a7f66894 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:43.132843 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-4e5cab2b-873b-40cf-8652-3935a7f66894 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:43.134512 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-4e5cab2b-873b-40cf-8652-3935a7f66894 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:43.136108 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-4e5cab2b-873b-40cf-8652-3935a7f66894 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1739 microversion: 2.20 time: 0.238231 Sep 03 03:51:43.136933 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 220/441] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:42 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1739 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:51:43.187747 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-171828a9-1104-4c5b-a710-07f3f3b1f45e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:43.197915 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-171828a9-1104-4c5b-a710-07f3f3b1f45e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1710 microversion: 2.1 time: 0.403499 Sep 03 03:51:43.199599 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 222/442] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:42 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1710 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:44.165700 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-b57f60bf-d8e5-416b-8a0f-340e6a22f960 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:44.166925 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-b57f60bf-d8e5-416b-8a0f-340e6a22f960 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:44.175749 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b57f60bf-d8e5-416b-8a0f-340e6a22f960 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:44.176516 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b57f60bf-d8e5-416b-8a0f-340e6a22f960 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:44.176951 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b57f60bf-d8e5-416b-8a0f-340e6a22f960 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:44.177749 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b57f60bf-d8e5-416b-8a0f-340e6a22f960 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:44.178200 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b57f60bf-d8e5-416b-8a0f-340e6a22f960 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:44.178640 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b57f60bf-d8e5-416b-8a0f-340e6a22f960 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:44.226148 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-9e90dd4b-73fd-4a22-a5d5-f26a8435c5b8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:44.227635 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-9e90dd4b-73fd-4a22-a5d5-f26a8435c5b8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:44.236680 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9e90dd4b-73fd-4a22-a5d5-f26a8435c5b8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:44.237684 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9e90dd4b-73fd-4a22-a5d5-f26a8435c5b8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:44.244064 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9e90dd4b-73fd-4a22-a5d5-f26a8435c5b8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:44.245100 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9e90dd4b-73fd-4a22-a5d5-f26a8435c5b8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:44.245678 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9e90dd4b-73fd-4a22-a5d5-f26a8435c5b8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:44.246234 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9e90dd4b-73fd-4a22-a5d5-f26a8435c5b8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:44.434730 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-9e90dd4b-73fd-4a22-a5d5-f26a8435c5b8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:44.444845 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-9e90dd4b-73fd-4a22-a5d5-f26a8435c5b8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1710 microversion: 2.1 time: 0.226614 Sep 03 03:51:44.447208 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 223/443] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:44 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1710 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:44.552358 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-b57f60bf-d8e5-416b-8a0f-340e6a22f960 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:44.560527 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-b57f60bf-d8e5-416b-8a0f-340e6a22f960 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:44.561948 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-b57f60bf-d8e5-416b-8a0f-340e6a22f960 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:44.563106 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-b57f60bf-d8e5-416b-8a0f-340e6a22f960 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1739 microversion: 2.20 time: 0.401267 Sep 03 03:51:44.563687 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 221/444] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:44 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1739 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:51:45.473841 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-3d0350ae-03a2-4588-8fce-674d46081634 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:45.474457 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-3d0350ae-03a2-4588-8fce-674d46081634 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:45.481019 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3d0350ae-03a2-4588-8fce-674d46081634 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:45.481497 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3d0350ae-03a2-4588-8fce-674d46081634 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:45.481926 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3d0350ae-03a2-4588-8fce-674d46081634 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:45.482999 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3d0350ae-03a2-4588-8fce-674d46081634 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:45.483498 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3d0350ae-03a2-4588-8fce-674d46081634 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:45.483916 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3d0350ae-03a2-4588-8fce-674d46081634 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:45.588205 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-943f9ec0-18f3-43ba-abde-92a746a5ac1e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:45.589024 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-943f9ec0-18f3-43ba-abde-92a746a5ac1e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:45.597546 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-943f9ec0-18f3-43ba-abde-92a746a5ac1e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:45.598120 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-943f9ec0-18f3-43ba-abde-92a746a5ac1e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:45.598632 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-943f9ec0-18f3-43ba-abde-92a746a5ac1e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:45.599476 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-943f9ec0-18f3-43ba-abde-92a746a5ac1e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:45.600040 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-943f9ec0-18f3-43ba-abde-92a746a5ac1e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:45.600762 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-943f9ec0-18f3-43ba-abde-92a746a5ac1e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:45.625870 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-3d0350ae-03a2-4588-8fce-674d46081634 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:45.634792 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-3d0350ae-03a2-4588-8fce-674d46081634 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1714 microversion: 2.1 time: 0.165058 Sep 03 03:51:45.635396 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 224/445] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:51:45 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1714 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:51:45.734438 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-943f9ec0-18f3-43ba-abde-92a746a5ac1e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:45.745072 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-943f9ec0-18f3-43ba-abde-92a746a5ac1e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:45.746491 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-943f9ec0-18f3-43ba-abde-92a746a5ac1e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:45.747668 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-943f9ec0-18f3-43ba-abde-92a746a5ac1e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1739 microversion: 2.20 time: 0.163789 Sep 03 03:51:45.748224 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 222/446] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:45 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 03:51:46.774255 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-14ce81ce-8b7d-4313-b845-dadd4bbca507 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:46.775492 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-14ce81ce-8b7d-4313-b845-dadd4bbca507 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:46.778347 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:51:46.783983 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-14ce81ce-8b7d-4313-b845-dadd4bbca507 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:46.784489 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-14ce81ce-8b7d-4313-b845-dadd4bbca507 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:46.784916 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-14ce81ce-8b7d-4313-b845-dadd4bbca507 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:46.785606 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-14ce81ce-8b7d-4313-b845-dadd4bbca507 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:46.786052 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-14ce81ce-8b7d-4313-b845-dadd4bbca507 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:46.786501 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-14ce81ce-8b7d-4313-b845-dadd4bbca507 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:47.082109 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-14ce81ce-8b7d-4313-b845-dadd4bbca507 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:47.090495 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-14ce81ce-8b7d-4313-b845-dadd4bbca507 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:47.092161 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-14ce81ce-8b7d-4313-b845-dadd4bbca507 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:47.093311 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-14ce81ce-8b7d-4313-b845-dadd4bbca507 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1721 microversion: 2.20 time: 0.323214 Sep 03 03:51:47.093862 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 225/447] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:46 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1721 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:51:48.120304 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-b5cb143f-3f85-417f-8aa4-4ef04fc48dd1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:48.120902 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-b5cb143f-3f85-417f-8aa4-4ef04fc48dd1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:48.127970 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b5cb143f-3f85-417f-8aa4-4ef04fc48dd1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:48.128437 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b5cb143f-3f85-417f-8aa4-4ef04fc48dd1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:48.128846 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b5cb143f-3f85-417f-8aa4-4ef04fc48dd1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:48.129677 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b5cb143f-3f85-417f-8aa4-4ef04fc48dd1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:48.130326 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b5cb143f-3f85-417f-8aa4-4ef04fc48dd1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:48.130952 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b5cb143f-3f85-417f-8aa4-4ef04fc48dd1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:48.268012 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-b5cb143f-3f85-417f-8aa4-4ef04fc48dd1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:48.276373 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-b5cb143f-3f85-417f-8aa4-4ef04fc48dd1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:48.278448 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-b5cb143f-3f85-417f-8aa4-4ef04fc48dd1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:48.280367 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-b5cb143f-3f85-417f-8aa4-4ef04fc48dd1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1721 microversion: 2.20 time: 0.164389 Sep 03 03:51:48.280930 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 223/448] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:48 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:51:49.307134 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-57447930-787f-431b-9cd8-837ca4725f7a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:49.307719 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-57447930-787f-431b-9cd8-837ca4725f7a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:49.314450 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-57447930-787f-431b-9cd8-837ca4725f7a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:49.314949 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-57447930-787f-431b-9cd8-837ca4725f7a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:49.315558 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-57447930-787f-431b-9cd8-837ca4725f7a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:49.316419 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-57447930-787f-431b-9cd8-837ca4725f7a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:49.317029 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-57447930-787f-431b-9cd8-837ca4725f7a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:49.317475 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-57447930-787f-431b-9cd8-837ca4725f7a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:49.607449 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-57447930-787f-431b-9cd8-837ca4725f7a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:49.617173 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-57447930-787f-431b-9cd8-837ca4725f7a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:49.619066 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-57447930-787f-431b-9cd8-837ca4725f7a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:49.620348 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-57447930-787f-431b-9cd8-837ca4725f7a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1721 microversion: 2.20 time: 0.317215 Sep 03 03:51:49.620949 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 226/449] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:49 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1721 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:51:49.998100 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-47b65e66-6e61-4e6c-8d57-5e318f31662b req-b0bd675f-8a92-48d4-bfc8-8dbae59ffb6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d61f1c-d865-4d0d-89a9-1f91f0f8bf78", "name": "network-vif-unplugged", "status": "completed", "tag": "dc502e70-8b66-4849-929e-0879ed88e591"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:51:50.011939 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-47b65e66-6e61-4e6c-8d57-5e318f31662b req-b0bd675f-8a92-48d4-bfc8-8dbae59ffb6e service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:50.019508 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-47b65e66-6e61-4e6c-8d57-5e318f31662b req-b0bd675f-8a92-48d4-bfc8-8dbae59ffb6e service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:50.020306 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-47b65e66-6e61-4e6c-8d57-5e318f31662b req-b0bd675f-8a92-48d4-bfc8-8dbae59ffb6e service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:50.034840 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-47b65e66-6e61-4e6c-8d57-5e318f31662b req-b0bd675f-8a92-48d4-bfc8-8dbae59ffb6e service nova] Creating event network-vif-unplugged:dc502e70-8b66-4849-929e-0879ed88e591 for instance 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 on hv-cinder-79966 Sep 03 03:51:50.044980 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-47b65e66-6e61-4e6c-8d57-5e318f31662b req-b0bd675f-8a92-48d4-bfc8-8dbae59ffb6e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046694 Sep 03 03:51:50.046009 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 224/450] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:51:50.648418 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-8ea40d81-d1ee-4408-81a3-91e06bf2fdfd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:50.649301 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-8ea40d81-d1ee-4408-81a3-91e06bf2fdfd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:50.656234 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8ea40d81-d1ee-4408-81a3-91e06bf2fdfd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:50.657032 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8ea40d81-d1ee-4408-81a3-91e06bf2fdfd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:50.657521 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8ea40d81-d1ee-4408-81a3-91e06bf2fdfd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:50.658507 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8ea40d81-d1ee-4408-81a3-91e06bf2fdfd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:50.659157 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8ea40d81-d1ee-4408-81a3-91e06bf2fdfd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:50.659683 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8ea40d81-d1ee-4408-81a3-91e06bf2fdfd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:50.878834 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-8ea40d81-d1ee-4408-81a3-91e06bf2fdfd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:50.895279 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-8ea40d81-d1ee-4408-81a3-91e06bf2fdfd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:50.897535 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-8ea40d81-d1ee-4408-81a3-91e06bf2fdfd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:50.899242 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-8ea40d81-d1ee-4408-81a3-91e06bf2fdfd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1721 microversion: 2.20 time: 0.254875 Sep 03 03:51:50.900489 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 227/451] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:50 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1721 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:51:51.925571 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-912c11e8-8e3b-42b4-8056-5e48b6df58e2 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:51.927231 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-912c11e8-8e3b-42b4-8056-5e48b6df58e2 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:51.935687 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-912c11e8-8e3b-42b4-8056-5e48b6df58e2 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:51.936203 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-912c11e8-8e3b-42b4-8056-5e48b6df58e2 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:51.937081 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-912c11e8-8e3b-42b4-8056-5e48b6df58e2 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:51.938016 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-912c11e8-8e3b-42b4-8056-5e48b6df58e2 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:51.938611 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-912c11e8-8e3b-42b4-8056-5e48b6df58e2 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:51.939252 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-912c11e8-8e3b-42b4-8056-5e48b6df58e2 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:52.169943 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-912c11e8-8e3b-42b4-8056-5e48b6df58e2 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:52.187292 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-912c11e8-8e3b-42b4-8056-5e48b6df58e2 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:52.194983 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-912c11e8-8e3b-42b4-8056-5e48b6df58e2 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:52.196632 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-912c11e8-8e3b-42b4-8056-5e48b6df58e2 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1724 microversion: 2.20 time: 0.275468 Sep 03 03:51:52.216892 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 225/452] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:51 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1724 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:51:52.229216 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-f9447e4e-275c-41c4-81d1-2fac3cf18891 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f84e91c4-8e6a-451b-9551-fe5c7727f2b4"}} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:51:52.231907 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-f9447e4e-275c-41c4-81d1-2fac3cf18891 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:52.246940 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f9447e4e-275c-41c4-81d1-2fac3cf18891 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:52.247666 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f9447e4e-275c-41c4-81d1-2fac3cf18891 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:52.248815 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f9447e4e-275c-41c4-81d1-2fac3cf18891 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:52.250400 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f9447e4e-275c-41c4-81d1-2fac3cf18891 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:52.252157 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f9447e4e-275c-41c4-81d1-2fac3cf18891 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:52.252761 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f9447e4e-275c-41c4-81d1-2fac3cf18891 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:52.672154 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-f9447e4e-275c-41c4-81d1-2fac3cf18891 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "POST /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.448710 Sep 03 03:51:52.672920 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 228/453] 10.222.0.25 () {62 vars in 1364 bytes} [Sat Sep 3 03:51:52 2022] POST /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78/os-volume_attachments => generated 188 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 03:51:52.812279 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-b143a1df-8f37-479f-aee4-6c2ed4f0580a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:51:52.812854 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-b143a1df-8f37-479f-aee4-6c2ed4f0580a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:52.819177 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b143a1df-8f37-479f-aee4-6c2ed4f0580a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:52.819893 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b143a1df-8f37-479f-aee4-6c2ed4f0580a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:52.820155 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b143a1df-8f37-479f-aee4-6c2ed4f0580a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:52.821018 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b143a1df-8f37-479f-aee4-6c2ed4f0580a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:52.821463 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b143a1df-8f37-479f-aee4-6c2ed4f0580a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:52.821881 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b143a1df-8f37-479f-aee4-6c2ed4f0580a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:52.881601 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-b143a1df-8f37-479f-aee4-6c2ed4f0580a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132077) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 03 03:51:52.966638 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-b143a1df-8f37-479f-aee4-6c2ed4f0580a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "POST /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78/action" status: 202 len: 0 microversion: 2.20 time: 0.158705 Sep 03 03:51:52.968386 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 226/454] 10.222.0.25 () {62 vars in 1319 bytes} [Sat Sep 3 03:51:52 2022] POST /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 03 03:51:52.976542 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-b893cb92-36ee-4211-8805-b3c908ea7742 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:52.977351 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-b893cb92-36ee-4211-8805-b3c908ea7742 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:52.985969 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b893cb92-36ee-4211-8805-b3c908ea7742 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:52.986533 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b893cb92-36ee-4211-8805-b3c908ea7742 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:52.987232 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b893cb92-36ee-4211-8805-b3c908ea7742 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:52.987999 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b893cb92-36ee-4211-8805-b3c908ea7742 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:52.988459 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b893cb92-36ee-4211-8805-b3c908ea7742 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:52.989093 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b893cb92-36ee-4211-8805-b3c908ea7742 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:53.142473 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-b893cb92-36ee-4211-8805-b3c908ea7742 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:53.152634 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-b893cb92-36ee-4211-8805-b3c908ea7742 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:53.154437 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-b893cb92-36ee-4211-8805-b3c908ea7742 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:53.156450 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-b893cb92-36ee-4211-8805-b3c908ea7742 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1750 microversion: 2.20 time: 0.184195 Sep 03 03:51:53.157808 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 229/455] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:52 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1750 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 03:51:54.183868 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-f7dd1dc3-bbb7-4e6b-a929-d9690447cf85 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:54.184751 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-f7dd1dc3-bbb7-4e6b-a929-d9690447cf85 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:54.199970 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f7dd1dc3-bbb7-4e6b-a929-d9690447cf85 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:54.201589 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f7dd1dc3-bbb7-4e6b-a929-d9690447cf85 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:54.202563 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f7dd1dc3-bbb7-4e6b-a929-d9690447cf85 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:54.205276 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f7dd1dc3-bbb7-4e6b-a929-d9690447cf85 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:54.205816 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f7dd1dc3-bbb7-4e6b-a929-d9690447cf85 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:54.209089 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f7dd1dc3-bbb7-4e6b-a929-d9690447cf85 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:54.465240 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-f7dd1dc3-bbb7-4e6b-a929-d9690447cf85 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:54.476891 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-f7dd1dc3-bbb7-4e6b-a929-d9690447cf85 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:54.478583 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-f7dd1dc3-bbb7-4e6b-a929-d9690447cf85 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:54.480051 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-f7dd1dc3-bbb7-4e6b-a929-d9690447cf85 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1750 microversion: 2.20 time: 0.301686 Sep 03 03:51:54.483791 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 227/456] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:54 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1750 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:51:55.505735 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-03e19d3e-5403-4ca1-b864-3e06b8a35c9f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:55.507046 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-03e19d3e-5403-4ca1-b864-3e06b8a35c9f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:55.521457 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-03e19d3e-5403-4ca1-b864-3e06b8a35c9f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:55.522430 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-03e19d3e-5403-4ca1-b864-3e06b8a35c9f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:55.523300 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-03e19d3e-5403-4ca1-b864-3e06b8a35c9f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:55.524013 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-03e19d3e-5403-4ca1-b864-3e06b8a35c9f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:55.525667 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-03e19d3e-5403-4ca1-b864-3e06b8a35c9f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:55.526136 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-03e19d3e-5403-4ca1-b864-3e06b8a35c9f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:55.736275 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-03e19d3e-5403-4ca1-b864-3e06b8a35c9f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:55.745603 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-03e19d3e-5403-4ca1-b864-3e06b8a35c9f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:55.748723 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-03e19d3e-5403-4ca1-b864-3e06b8a35c9f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:55.750052 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-03e19d3e-5403-4ca1-b864-3e06b8a35c9f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1752 microversion: 2.20 time: 0.248294 Sep 03 03:51:55.751025 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 230/457] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:55 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1752 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:51:56.780038 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-3f533468-ff84-404b-8670-b02baf538326 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:56.780561 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-3f533468-ff84-404b-8670-b02baf538326 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:56.794372 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3f533468-ff84-404b-8670-b02baf538326 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:56.794884 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3f533468-ff84-404b-8670-b02baf538326 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:56.795315 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3f533468-ff84-404b-8670-b02baf538326 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:56.796031 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3f533468-ff84-404b-8670-b02baf538326 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:56.796525 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3f533468-ff84-404b-8670-b02baf538326 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:56.797080 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3f533468-ff84-404b-8670-b02baf538326 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:57.005103 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-3f533468-ff84-404b-8670-b02baf538326 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:57.015105 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-3f533468-ff84-404b-8670-b02baf538326 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:57.017532 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-3f533468-ff84-404b-8670-b02baf538326 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:57.018687 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-3f533468-ff84-404b-8670-b02baf538326 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1808 microversion: 2.20 time: 0.242915 Sep 03 03:51:57.031284 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 228/458] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:56 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1808 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:51:58.044087 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-73b4b07d-b913-4802-8423-1673db487691 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:58.044975 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-73b4b07d-b913-4802-8423-1673db487691 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:58.052556 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-73b4b07d-b913-4802-8423-1673db487691 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:58.054268 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-73b4b07d-b913-4802-8423-1673db487691 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:58.055102 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-73b4b07d-b913-4802-8423-1673db487691 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:58.055905 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-73b4b07d-b913-4802-8423-1673db487691 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:58.056694 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-73b4b07d-b913-4802-8423-1673db487691 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:58.057214 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-73b4b07d-b913-4802-8423-1673db487691 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:58.193879 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-1e83ede8-ee92-47f3-aa3f-7652953aaf7e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Action: 'create', calling method: .version_select at 0x7f45fc781790>, body: {"keypair": {"name": "tempest-TestShelveInstance-20485509", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBO1Bp1ON5SoROI+ke11IrfG0il1ulUniQayYutX6834OnxTau0Lxl73XUXlIZ2RrUaYNhXoHfOhNjzB2vslltxo4H7OSfcVegk1VuiI0u5aTwHwYlm5C3c0bn442HFfQ=="}} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:51:58.213789 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.quota [None req-1e83ede8-ee92-47f3-aa3f-7652953aaf7e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Getting quotas for project 5ced06c15af249bf92f546d0a0bfba23. Resources: {'key_pairs'} {{(pid=132077) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 03:51:58.219441 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.quota [None req-1e83ede8-ee92-47f3-aa3f-7652953aaf7e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Getting quotas for user 687629f84f1f408d8e80a5a1b28eb787 and project 5ced06c15af249bf92f546d0a0bfba23. Resources: {'key_pairs'} {{(pid=132077) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 03:51:58.223316 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-73b4b07d-b913-4802-8423-1673db487691 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:58.237665 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-73b4b07d-b913-4802-8423-1673db487691 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:58.237665 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-73b4b07d-b913-4802-8423-1673db487691 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:58.238044 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-73b4b07d-b913-4802-8423-1673db487691 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1808 microversion: 2.20 time: 0.197630 Sep 03 03:51:58.238703 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 231/459] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:58 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 03:51:58.250458 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-1e83ede8-ee92-47f3-aa3f-7652953aaf7e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.173756 Sep 03 03:51:58.262686 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 229/460] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Sep 3 03:51:58 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:51:59.269279 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-9e4e5a7f-12ad-48da-88f1-c7f78b6e45bc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:51:59.271627 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-9e4e5a7f-12ad-48da-88f1-c7f78b6e45bc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:51:59.282388 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9e4e5a7f-12ad-48da-88f1-c7f78b6e45bc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:59.283151 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9e4e5a7f-12ad-48da-88f1-c7f78b6e45bc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:59.283786 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9e4e5a7f-12ad-48da-88f1-c7f78b6e45bc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:59.284742 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9e4e5a7f-12ad-48da-88f1-c7f78b6e45bc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:51:59.285283 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9e4e5a7f-12ad-48da-88f1-c7f78b6e45bc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:51:59.285973 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9e4e5a7f-12ad-48da-88f1-c7f78b6e45bc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:51:59.455813 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-9e4e5a7f-12ad-48da-88f1-c7f78b6e45bc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:59.465071 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-9e4e5a7f-12ad-48da-88f1-c7f78b6e45bc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:59.466829 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-9e4e5a7f-12ad-48da-88f1-c7f78b6e45bc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:51:59.468045 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-9e4e5a7f-12ad-48da-88f1-c7f78b6e45bc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1808 microversion: 2.20 time: 0.204860 Sep 03 03:51:59.468661 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 232/461] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:51:59 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1808 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:52:00.501861 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-d80b2b31-ea67-42eb-afdf-a29ddf0e3385 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:00.503190 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-d80b2b31-ea67-42eb-afdf-a29ddf0e3385 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:00.505242 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:52:00.514101 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d80b2b31-ea67-42eb-afdf-a29ddf0e3385 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:00.515137 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d80b2b31-ea67-42eb-afdf-a29ddf0e3385 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:00.515719 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d80b2b31-ea67-42eb-afdf-a29ddf0e3385 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:00.516984 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d80b2b31-ea67-42eb-afdf-a29ddf0e3385 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:00.517585 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d80b2b31-ea67-42eb-afdf-a29ddf0e3385 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:00.518254 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d80b2b31-ea67-42eb-afdf-a29ddf0e3385 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:00.696716 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-d80b2b31-ea67-42eb-afdf-a29ddf0e3385 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:00.705865 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-d80b2b31-ea67-42eb-afdf-a29ddf0e3385 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:00.708010 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-d80b2b31-ea67-42eb-afdf-a29ddf0e3385 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:00.709200 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-d80b2b31-ea67-42eb-afdf-a29ddf0e3385 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1808 microversion: 2.20 time: 0.218026 Sep 03 03:52:00.709966 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 230/462] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:52:00 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1808 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 03:52:01.737303 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-8f0ab073-601a-487f-bdf3-2d9ccb0393e5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:01.737921 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-8f0ab073-601a-487f-bdf3-2d9ccb0393e5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:01.745034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8f0ab073-601a-487f-bdf3-2d9ccb0393e5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:01.745527 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8f0ab073-601a-487f-bdf3-2d9ccb0393e5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:01.745950 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8f0ab073-601a-487f-bdf3-2d9ccb0393e5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:01.746643 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8f0ab073-601a-487f-bdf3-2d9ccb0393e5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:01.747113 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8f0ab073-601a-487f-bdf3-2d9ccb0393e5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:01.747714 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8f0ab073-601a-487f-bdf3-2d9ccb0393e5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:01.752719 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:52:01.912149 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-8f0ab073-601a-487f-bdf3-2d9ccb0393e5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:01.922659 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-8f0ab073-601a-487f-bdf3-2d9ccb0393e5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:01.924122 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-8f0ab073-601a-487f-bdf3-2d9ccb0393e5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:01.925303 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-8f0ab073-601a-487f-bdf3-2d9ccb0393e5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1808 microversion: 2.20 time: 0.192139 Sep 03 03:52:01.926610 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 233/463] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:52:01 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:52:02.951676 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-2fbef066-84d8-4e01-9137-69223dc7b0f4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:02.952277 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-2fbef066-84d8-4e01-9137-69223dc7b0f4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:02.959080 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2fbef066-84d8-4e01-9137-69223dc7b0f4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:02.959547 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2fbef066-84d8-4e01-9137-69223dc7b0f4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:02.960107 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2fbef066-84d8-4e01-9137-69223dc7b0f4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:02.960777 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2fbef066-84d8-4e01-9137-69223dc7b0f4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:02.961588 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2fbef066-84d8-4e01-9137-69223dc7b0f4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:02.962297 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2fbef066-84d8-4e01-9137-69223dc7b0f4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:03.125082 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-2fbef066-84d8-4e01-9137-69223dc7b0f4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:03.128541 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:52:03.138315 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-2fbef066-84d8-4e01-9137-69223dc7b0f4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:03.139846 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-2fbef066-84d8-4e01-9137-69223dc7b0f4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:03.141283 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-2fbef066-84d8-4e01-9137-69223dc7b0f4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1808 microversion: 2.20 time: 0.193918 Sep 03 03:52:03.156092 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 231/464] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:52:02 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:52:04.168933 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-ac6627df-3d63-4d46-9459-3b4b81973137 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:04.169492 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-ac6627df-3d63-4d46-9459-3b4b81973137 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:04.176096 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ac6627df-3d63-4d46-9459-3b4b81973137 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:04.176574 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ac6627df-3d63-4d46-9459-3b4b81973137 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:04.177004 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ac6627df-3d63-4d46-9459-3b4b81973137 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:04.177727 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ac6627df-3d63-4d46-9459-3b4b81973137 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:04.178180 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ac6627df-3d63-4d46-9459-3b4b81973137 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:04.178595 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ac6627df-3d63-4d46-9459-3b4b81973137 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:04.294280 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-a0803be5-88c1-4e4e-81f4-c1b4b6e4b20f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:04.294948 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-a0803be5-88c1-4e4e-81f4-c1b4b6e4b20f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 12cfe47d-e76d-4318-b163-eacbda0af541] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:04.314508 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a0803be5-88c1-4e4e-81f4-c1b4b6e4b20f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:04.315731 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a0803be5-88c1-4e4e-81f4-c1b4b6e4b20f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:04.316558 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a0803be5-88c1-4e4e-81f4-c1b4b6e4b20f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:04.317978 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a0803be5-88c1-4e4e-81f4-c1b4b6e4b20f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:04.318900 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a0803be5-88c1-4e4e-81f4-c1b4b6e4b20f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:04.319862 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a0803be5-88c1-4e4e-81f4-c1b4b6e4b20f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:04.358937 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-ac6627df-3d63-4d46-9459-3b4b81973137 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:04.370039 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-ac6627df-3d63-4d46-9459-3b4b81973137 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:04.371511 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-ac6627df-3d63-4d46-9459-3b4b81973137 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:04.372668 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-ac6627df-3d63-4d46-9459-3b4b81973137 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1808 microversion: 2.20 time: 0.207753 Sep 03 03:52:04.386830 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 234/465] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:52:04 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1808 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:52:04.481577 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.objects.instance [None req-a0803be5-88c1-4e4e-81f4-c1b4b6e4b20f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lazy-loading 'services' on Instance uuid 12cfe47d-e76d-4318-b163-eacbda0af541 {{(pid=132077) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 03:52:04.600548 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-a0803be5-88c1-4e4e-81f4-c1b4b6e4b20f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "DELETE /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541/os-volume_attachments/dcafb92e-2915-4d59-95b6-3e84b8330ffc" status: 202 len: 0 microversion: 2.1 time: 0.312576 Sep 03 03:52:04.601171 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 232/466] 10.222.0.25 () {58 vars in 1416 bytes} [Sat Sep 3 03:52:04 2022] DELETE /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541/os-volume_attachments/dcafb92e-2915-4d59-95b6-3e84b8330ffc => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 03:52:05.406324 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-dd41658e-8c97-4ef6-ac31-4fea71d3579b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:05.407575 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-dd41658e-8c97-4ef6-ac31-4fea71d3579b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:05.415695 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-dd41658e-8c97-4ef6-ac31-4fea71d3579b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:05.416189 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-dd41658e-8c97-4ef6-ac31-4fea71d3579b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:05.416687 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-dd41658e-8c97-4ef6-ac31-4fea71d3579b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:05.418613 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-dd41658e-8c97-4ef6-ac31-4fea71d3579b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:05.419097 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-dd41658e-8c97-4ef6-ac31-4fea71d3579b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:05.422609 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-dd41658e-8c97-4ef6-ac31-4fea71d3579b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:05.597304 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-dd41658e-8c97-4ef6-ac31-4fea71d3579b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:05.607284 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-dd41658e-8c97-4ef6-ac31-4fea71d3579b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:05.608722 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-dd41658e-8c97-4ef6-ac31-4fea71d3579b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:05.609919 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-dd41658e-8c97-4ef6-ac31-4fea71d3579b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1808 microversion: 2.20 time: 0.208877 Sep 03 03:52:05.610485 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 235/467] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:52:05 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1808 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:52:06.637466 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-4908dfd7-f6a9-4f7b-9b72-fc40525dd660 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:06.638088 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-4908dfd7-f6a9-4f7b-9b72-fc40525dd660 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:06.645561 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4908dfd7-f6a9-4f7b-9b72-fc40525dd660 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:06.646633 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4908dfd7-f6a9-4f7b-9b72-fc40525dd660 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:06.647329 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4908dfd7-f6a9-4f7b-9b72-fc40525dd660 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:06.648250 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4908dfd7-f6a9-4f7b-9b72-fc40525dd660 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:06.648703 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4908dfd7-f6a9-4f7b-9b72-fc40525dd660 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:06.649126 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4908dfd7-f6a9-4f7b-9b72-fc40525dd660 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:06.799941 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-4908dfd7-f6a9-4f7b-9b72-fc40525dd660 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:06.810239 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-4908dfd7-f6a9-4f7b-9b72-fc40525dd660 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:06.812018 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-4908dfd7-f6a9-4f7b-9b72-fc40525dd660 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:06.813290 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-4908dfd7-f6a9-4f7b-9b72-fc40525dd660 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1808 microversion: 2.20 time: 0.180508 Sep 03 03:52:06.814857 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 233/468] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:52:06 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:52:07.838316 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-6bb5a41e-bece-4b2b-9f46-d797622ca692 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:07.838969 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-6bb5a41e-bece-4b2b-9f46-d797622ca692 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:07.845968 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6bb5a41e-bece-4b2b-9f46-d797622ca692 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:07.846447 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6bb5a41e-bece-4b2b-9f46-d797622ca692 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:07.846874 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6bb5a41e-bece-4b2b-9f46-d797622ca692 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:07.847822 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6bb5a41e-bece-4b2b-9f46-d797622ca692 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:07.848480 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6bb5a41e-bece-4b2b-9f46-d797622ca692 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:07.849104 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6bb5a41e-bece-4b2b-9f46-d797622ca692 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:07.989839 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-6bb5a41e-bece-4b2b-9f46-d797622ca692 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:07.999825 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-6bb5a41e-bece-4b2b-9f46-d797622ca692 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:08.001251 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-6bb5a41e-bece-4b2b-9f46-d797622ca692 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:08.002429 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-6bb5a41e-bece-4b2b-9f46-d797622ca692 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1808 microversion: 2.20 time: 0.167979 Sep 03 03:52:08.003033 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 236/469] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:52:07 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:52:09.028273 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-f9670e51-6d1c-4170-a306-bfabd2a5710e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:09.028979 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-f9670e51-6d1c-4170-a306-bfabd2a5710e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:09.031384 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell0:SELECT=4 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:52:09.036790 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f9670e51-6d1c-4170-a306-bfabd2a5710e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:09.037328 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f9670e51-6d1c-4170-a306-bfabd2a5710e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:09.037769 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f9670e51-6d1c-4170-a306-bfabd2a5710e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:09.038462 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f9670e51-6d1c-4170-a306-bfabd2a5710e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:09.039136 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f9670e51-6d1c-4170-a306-bfabd2a5710e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:09.039555 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f9670e51-6d1c-4170-a306-bfabd2a5710e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:09.179394 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-f9670e51-6d1c-4170-a306-bfabd2a5710e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:09.188703 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-f9670e51-6d1c-4170-a306-bfabd2a5710e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:09.190210 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-f9670e51-6d1c-4170-a306-bfabd2a5710e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:09.191546 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-f9670e51-6d1c-4170-a306-bfabd2a5710e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1808 microversion: 2.20 time: 0.167378 Sep 03 03:52:09.198872 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 234/470] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:52:09 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:52:10.228124 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-77fe5932-530c-4464-9548-72f0681793d8 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:10.228843 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-77fe5932-530c-4464-9548-72f0681793d8 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:10.241429 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-77fe5932-530c-4464-9548-72f0681793d8 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:10.241907 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-77fe5932-530c-4464-9548-72f0681793d8 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:10.242326 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-77fe5932-530c-4464-9548-72f0681793d8 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:10.243052 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-77fe5932-530c-4464-9548-72f0681793d8 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:10.243490 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-77fe5932-530c-4464-9548-72f0681793d8 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:10.243898 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-77fe5932-530c-4464-9548-72f0681793d8 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:10.389105 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-77fe5932-530c-4464-9548-72f0681793d8 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:10.399050 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-77fe5932-530c-4464-9548-72f0681793d8 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:10.401874 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-77fe5932-530c-4464-9548-72f0681793d8 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:10.403934 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-77fe5932-530c-4464-9548-72f0681793d8 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1808 microversion: 2.20 time: 0.188596 Sep 03 03:52:10.404897 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 237/471] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:52:10 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 03:52:11.430990 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-36057235-a2d1-4b54-b18a-de57967f5016 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:11.431658 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-36057235-a2d1-4b54-b18a-de57967f5016 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:11.438325 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-36057235-a2d1-4b54-b18a-de57967f5016 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:11.438826 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-36057235-a2d1-4b54-b18a-de57967f5016 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:11.439276 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-36057235-a2d1-4b54-b18a-de57967f5016 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:11.439975 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-36057235-a2d1-4b54-b18a-de57967f5016 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:11.440426 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-36057235-a2d1-4b54-b18a-de57967f5016 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:11.440845 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-36057235-a2d1-4b54-b18a-de57967f5016 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:11.590931 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-36057235-a2d1-4b54-b18a-de57967f5016 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:11.600117 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-36057235-a2d1-4b54-b18a-de57967f5016 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:11.601623 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-36057235-a2d1-4b54-b18a-de57967f5016 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:11.602779 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-36057235-a2d1-4b54-b18a-de57967f5016 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1808 microversion: 2.20 time: 0.176098 Sep 03 03:52:11.603362 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 235/472] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:52:11 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:52:12.630016 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-0e5b504a-ce94-4892-8d89-1aeeb7cd80d1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:12.631058 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-0e5b504a-ce94-4892-8d89-1aeeb7cd80d1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:12.638502 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0e5b504a-ce94-4892-8d89-1aeeb7cd80d1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:12.639145 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0e5b504a-ce94-4892-8d89-1aeeb7cd80d1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:12.639989 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0e5b504a-ce94-4892-8d89-1aeeb7cd80d1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:12.641205 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0e5b504a-ce94-4892-8d89-1aeeb7cd80d1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:12.641848 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0e5b504a-ce94-4892-8d89-1aeeb7cd80d1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:12.642434 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0e5b504a-ce94-4892-8d89-1aeeb7cd80d1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:12.795049 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-0e5b504a-ce94-4892-8d89-1aeeb7cd80d1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:12.804963 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-0e5b504a-ce94-4892-8d89-1aeeb7cd80d1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:12.806481 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-0e5b504a-ce94-4892-8d89-1aeeb7cd80d1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:12.807747 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-0e5b504a-ce94-4892-8d89-1aeeb7cd80d1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1808 microversion: 2.20 time: 0.182632 Sep 03 03:52:12.808343 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 238/473] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:52:12 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:52:13.837072 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-194d8657-8716-487f-a1a9-5a52442a36d0 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:13.837874 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-194d8657-8716-487f-a1a9-5a52442a36d0 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:13.846185 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-194d8657-8716-487f-a1a9-5a52442a36d0 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:13.846780 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-194d8657-8716-487f-a1a9-5a52442a36d0 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:13.847357 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-194d8657-8716-487f-a1a9-5a52442a36d0 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:13.848214 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-194d8657-8716-487f-a1a9-5a52442a36d0 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:13.848769 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-194d8657-8716-487f-a1a9-5a52442a36d0 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:13.849289 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-194d8657-8716-487f-a1a9-5a52442a36d0 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:13.997835 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-194d8657-8716-487f-a1a9-5a52442a36d0 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:14.007479 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-194d8657-8716-487f-a1a9-5a52442a36d0 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:14.009015 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-194d8657-8716-487f-a1a9-5a52442a36d0 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:14.010275 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-194d8657-8716-487f-a1a9-5a52442a36d0 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1808 microversion: 2.20 time: 0.179065 Sep 03 03:52:14.021148 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 236/474] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:52:13 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:52:15.046046 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-544603c1-a82b-471e-9c6c-e8c6968682b3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:15.046637 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-544603c1-a82b-471e-9c6c-e8c6968682b3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:15.055237 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-544603c1-a82b-471e-9c6c-e8c6968682b3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:15.055717 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-544603c1-a82b-471e-9c6c-e8c6968682b3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:15.056138 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-544603c1-a82b-471e-9c6c-e8c6968682b3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:15.056814 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-544603c1-a82b-471e-9c6c-e8c6968682b3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:15.057252 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-544603c1-a82b-471e-9c6c-e8c6968682b3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:15.057662 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-544603c1-a82b-471e-9c6c-e8c6968682b3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:15.501259 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-544603c1-a82b-471e-9c6c-e8c6968682b3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:15.513911 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-544603c1-a82b-471e-9c6c-e8c6968682b3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:15.515513 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-544603c1-a82b-471e-9c6c-e8c6968682b3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:15.517509 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-544603c1-a82b-471e-9c6c-e8c6968682b3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1808 microversion: 2.20 time: 0.477369 Sep 03 03:52:15.518147 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 239/475] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:52:15 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1808 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 03:52:16.398659 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-e000a8d4-1085-4a02-8a95-a8162c9b426b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:16.399254 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-e000a8d4-1085-4a02-8a95-a8162c9b426b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 12cfe47d-e76d-4318-b163-eacbda0af541] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:16.407205 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e000a8d4-1085-4a02-8a95-a8162c9b426b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:16.407717 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e000a8d4-1085-4a02-8a95-a8162c9b426b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:16.408140 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e000a8d4-1085-4a02-8a95-a8162c9b426b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:16.408827 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e000a8d4-1085-4a02-8a95-a8162c9b426b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:16.409271 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e000a8d4-1085-4a02-8a95-a8162c9b426b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:16.409714 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e000a8d4-1085-4a02-8a95-a8162c9b426b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:16.434753 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-e000a8d4-1085-4a02-8a95-a8162c9b426b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 12cfe47d-e76d-4318-b163-eacbda0af541] Going to try to terminate instance {{(pid=132077) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 03:52:16.516370 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-e000a8d4-1085-4a02-8a95-a8162c9b426b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "DELETE /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541" status: 204 len: 0 microversion: 2.1 time: 0.123549 Sep 03 03:52:16.517413 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 237/476] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Sep 3 03:52:16 2022] DELETE /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 03:52:16.526512 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-5e2b6c77-44ef-42de-b56f-3a50b6f6333f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:16.527443 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-5e2b6c77-44ef-42de-b56f-3a50b6f6333f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 12cfe47d-e76d-4318-b163-eacbda0af541] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:16.533862 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5e2b6c77-44ef-42de-b56f-3a50b6f6333f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:16.534346 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5e2b6c77-44ef-42de-b56f-3a50b6f6333f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:16.535014 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5e2b6c77-44ef-42de-b56f-3a50b6f6333f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:16.535649 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5e2b6c77-44ef-42de-b56f-3a50b6f6333f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:16.536091 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5e2b6c77-44ef-42de-b56f-3a50b6f6333f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:16.536514 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5e2b6c77-44ef-42de-b56f-3a50b6f6333f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:16.546396 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-de0346d7-e174-4656-94db-4ac3922ed1e9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:16.547614 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-de0346d7-e174-4656-94db-4ac3922ed1e9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:16.553478 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-de0346d7-e174-4656-94db-4ac3922ed1e9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:16.553943 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-de0346d7-e174-4656-94db-4ac3922ed1e9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:16.554365 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-de0346d7-e174-4656-94db-4ac3922ed1e9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:16.555070 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-de0346d7-e174-4656-94db-4ac3922ed1e9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:16.555511 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-de0346d7-e174-4656-94db-4ac3922ed1e9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:16.555924 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-de0346d7-e174-4656-94db-4ac3922ed1e9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:16.679165 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-5e2b6c77-44ef-42de-b56f-3a50b6f6333f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0647075204ba183fb1e5beb2c5930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bafae6685e248d2ac4fab672648e941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:16.687474 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-5e2b6c77-44ef-42de-b56f-3a50b6f6333f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541" status: 200 len: 1513 microversion: 2.1 time: 0.165250 Sep 03 03:52:16.688049 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 240/477] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:16 2022] GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:16.688968 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-de0346d7-e174-4656-94db-4ac3922ed1e9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:16.697616 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-de0346d7-e174-4656-94db-4ac3922ed1e9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:16.699048 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-de0346d7-e174-4656-94db-4ac3922ed1e9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:16.700175 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-de0346d7-e174-4656-94db-4ac3922ed1e9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1808 microversion: 2.20 time: 0.158175 Sep 03 03:52:16.702644 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 238/478] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:52:16 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 03:52:17.715745 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-1b6030ac-9327-43f6-9f30-794a184a7687 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:17.716660 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-1b6030ac-9327-43f6-9f30-794a184a7687 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 12cfe47d-e76d-4318-b163-eacbda0af541] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:17.720284 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_api:SELECT=32 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:52:17.727958 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-cc4a1c87-691d-4011-81ea-8b8660f09557 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:17.728443 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1b6030ac-9327-43f6-9f30-794a184a7687 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:17.728569 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-cc4a1c87-691d-4011-81ea-8b8660f09557 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:17.728680 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1b6030ac-9327-43f6-9f30-794a184a7687 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:17.729008 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1b6030ac-9327-43f6-9f30-794a184a7687 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:17.729695 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1b6030ac-9327-43f6-9f30-794a184a7687 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:17.730124 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1b6030ac-9327-43f6-9f30-794a184a7687 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:17.730538 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1b6030ac-9327-43f6-9f30-794a184a7687 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:17.735229 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cc4a1c87-691d-4011-81ea-8b8660f09557 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:17.735701 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cc4a1c87-691d-4011-81ea-8b8660f09557 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:17.736123 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cc4a1c87-691d-4011-81ea-8b8660f09557 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:17.736806 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cc4a1c87-691d-4011-81ea-8b8660f09557 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:17.737247 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cc4a1c87-691d-4011-81ea-8b8660f09557 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:17.737654 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cc4a1c87-691d-4011-81ea-8b8660f09557 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:17.873330 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-cc4a1c87-691d-4011-81ea-8b8660f09557 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:17.875935 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-1b6030ac-9327-43f6-9f30-794a184a7687 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0647075204ba183fb1e5beb2c5930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bafae6685e248d2ac4fab672648e941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:17.882356 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-cc4a1c87-691d-4011-81ea-8b8660f09557 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:17.883553 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-1b6030ac-9327-43f6-9f30-794a184a7687 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541" status: 200 len: 1513 microversion: 2.1 time: 0.174202 Sep 03 03:52:17.883996 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-cc4a1c87-691d-4011-81ea-8b8660f09557 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:17.884158 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 241/479] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:17 2022] GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541 => generated 1513 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:17.886037 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-cc4a1c87-691d-4011-81ea-8b8660f09557 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1808 microversion: 2.20 time: 0.163198 Sep 03 03:52:17.886793 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 239/480] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:52:17 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:52:18.911317 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-9e8a224c-ca49-418a-bfb4-e00bcab73d30 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:18.912037 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-be61b655-6ce2-48c9-9cba-2227678e4020 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:18.912479 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-be61b655-6ce2-48c9-9cba-2227678e4020 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 12cfe47d-e76d-4318-b163-eacbda0af541] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:18.913277 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-9e8a224c-ca49-418a-bfb4-e00bcab73d30 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:18.919696 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9e8a224c-ca49-418a-bfb4-e00bcab73d30 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:18.920381 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9e8a224c-ca49-418a-bfb4-e00bcab73d30 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:18.920999 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9e8a224c-ca49-418a-bfb4-e00bcab73d30 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:18.921840 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9e8a224c-ca49-418a-bfb4-e00bcab73d30 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:18.922521 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9e8a224c-ca49-418a-bfb4-e00bcab73d30 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:18.923238 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9e8a224c-ca49-418a-bfb4-e00bcab73d30 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:18.923658 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-be61b655-6ce2-48c9-9cba-2227678e4020 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:18.924145 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-be61b655-6ce2-48c9-9cba-2227678e4020 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:18.924568 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-be61b655-6ce2-48c9-9cba-2227678e4020 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:18.925386 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-be61b655-6ce2-48c9-9cba-2227678e4020 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:18.925952 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-be61b655-6ce2-48c9-9cba-2227678e4020 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:18.926522 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-be61b655-6ce2-48c9-9cba-2227678e4020 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:19.068948 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-9e8a224c-ca49-418a-bfb4-e00bcab73d30 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:19.077898 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-9e8a224c-ca49-418a-bfb4-e00bcab73d30 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:19.079301 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-9e8a224c-ca49-418a-bfb4-e00bcab73d30 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:19.080547 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-9e8a224c-ca49-418a-bfb4-e00bcab73d30 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1808 microversion: 2.20 time: 0.173043 Sep 03 03:52:19.095228 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 240/481] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:52:18 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:52:19.104299 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-6ef4ee12-72dd-487a-bb08-316d7c00566e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1382662644", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-20485509", "security_groups": [{"name": "tempest-secgroup-smoke-757017233"}], "networks": [{"uuid": "90887e4a-8d76-4923-bce4-beaf608c5942"}], "block_device_mapping_v2": [{"uuid": "30919da5-2b84-4b70-8ede-396a5988e817", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:52:19.168312 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-be61b655-6ce2-48c9-9cba-2227678e4020 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0647075204ba183fb1e5beb2c5930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bafae6685e248d2ac4fab672648e941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:19.176573 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-be61b655-6ce2-48c9-9cba-2227678e4020 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541" status: 200 len: 1513 microversion: 2.1 time: 0.273887 Sep 03 03:52:19.177245 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 242/482] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:18 2022] GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541 => generated 1513 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:19.220669 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.network.neutron [None req-6ef4ee12-72dd-487a-bb08-316d7c00566e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] validate_networks() for [('90887e4a-8d76-4923-bce4-beaf608c5942', None, None, None, None, None)] {{(pid=132077) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 03:52:19.457337 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-218adc0d-d971-42d6-8dbd-973914423229 req-66137fc9-2584-45a3-9ca6-7c8ea8d4e859 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12cfe47d-e76d-4318-b163-eacbda0af541", "name": "network-vif-deleted", "tag": "6cda611e-3725-48d2-aa18-b249345b2805"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:52:19.467317 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-218adc0d-d971-42d6-8dbd-973914423229 req-66137fc9-2584-45a3-9ca6-7c8ea8d4e859 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:19.468056 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-218adc0d-d971-42d6-8dbd-973914423229 req-66137fc9-2584-45a3-9ca6-7c8ea8d4e859 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:19.468480 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-218adc0d-d971-42d6-8dbd-973914423229 req-66137fc9-2584-45a3-9ca6-7c8ea8d4e859 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:19.480301 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-218adc0d-d971-42d6-8dbd-973914423229 req-66137fc9-2584-45a3-9ca6-7c8ea8d4e859 service nova] Creating event network-vif-deleted:6cda611e-3725-48d2-aa18-b249345b2805 for instance 12cfe47d-e76d-4318-b163-eacbda0af541 on hv-cinder-79966 Sep 03 03:52:19.486270 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-218adc0d-d971-42d6-8dbd-973914423229 req-66137fc9-2584-45a3-9ca6-7c8ea8d4e859 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032505 Sep 03 03:52:19.487019 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 243/483] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:52:19.652466 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-6ef4ee12-72dd-487a-bb08-316d7c00566e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Flavor limits 0:0:0 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 03:52:19.653315 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-6ef4ee12-72dd-487a-bb08-316d7c00566e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Image limits 0:0:0 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 03:52:19.653944 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-6ef4ee12-72dd-487a-bb08-316d7c00566e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Flavor pref 0:0:0 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 03:52:19.654543 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-6ef4ee12-72dd-487a-bb08-316d7c00566e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Image pref 0:0:0 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 03:52:19.654984 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-6ef4ee12-72dd-487a-bb08-316d7c00566e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 03:52:19.665690 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6ef4ee12-72dd-487a-bb08-316d7c00566e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:19.666463 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6ef4ee12-72dd-487a-bb08-316d7c00566e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:19.667081 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6ef4ee12-72dd-487a-bb08-316d7c00566e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:19.667902 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6ef4ee12-72dd-487a-bb08-316d7c00566e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:19.668615 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6ef4ee12-72dd-487a-bb08-316d7c00566e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:19.669038 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6ef4ee12-72dd-487a-bb08-316d7c00566e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:19.688177 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.quota [None req-6ef4ee12-72dd-487a-bb08-316d7c00566e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Getting quotas for project 5ced06c15af249bf92f546d0a0bfba23. Resources: {'ram', 'instances', 'cores'} {{(pid=132077) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 03:52:19.692765 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.quota [None req-6ef4ee12-72dd-487a-bb08-316d7c00566e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Getting quotas for user 687629f84f1f408d8e80a5a1b28eb787 and project 5ced06c15af249bf92f546d0a0bfba23. Resources: {'ram', 'instances', 'cores'} {{(pid=132077) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 03:52:19.748596 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-6ef4ee12-72dd-487a-bb08-316d7c00566e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Going to run 1 instances... {{(pid=132077) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 03:52:19.750842 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-6ef4ee12-72dd-487a-bb08-316d7c00566e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='30919da5-2b84-4b70-8ede-396a5988e817',volume_size=None,volume_type=None)] {{(pid=132077) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 03:52:19.884678 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-6ef4ee12-72dd-487a-bb08-316d7c00566e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.788310 Sep 03 03:52:19.885314 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 241/484] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Sep 3 03:52:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 03:52:19.897187 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-061e1306-2bfd-45fb-ad9b-b801883fc32e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:19.897792 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-061e1306-2bfd-45fb-ad9b-b801883fc32e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:19.956358 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-061e1306-2bfd-45fb-ad9b-b801883fc32e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:19.963277 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-061e1306-2bfd-45fb-ad9b-b801883fc32e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1087 microversion: 2.1 time: 0.070369 Sep 03 03:52:19.963894 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 244/485] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:19 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1087 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:20.111636 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-b65c459b-dd34-4fff-9a47-0f3055142af3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:20.113104 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-b65c459b-dd34-4fff-9a47-0f3055142af3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:20.120717 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b65c459b-dd34-4fff-9a47-0f3055142af3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:20.121598 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b65c459b-dd34-4fff-9a47-0f3055142af3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:20.122050 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b65c459b-dd34-4fff-9a47-0f3055142af3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:20.122959 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b65c459b-dd34-4fff-9a47-0f3055142af3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:20.123566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b65c459b-dd34-4fff-9a47-0f3055142af3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:20.124150 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b65c459b-dd34-4fff-9a47-0f3055142af3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:20.205413 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-2ddf7d1f-1094-48fa-bc30-0dfc93a9841b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:20.206311 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-2ddf7d1f-1094-48fa-bc30-0dfc93a9841b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 12cfe47d-e76d-4318-b163-eacbda0af541] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:20.215479 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2ddf7d1f-1094-48fa-bc30-0dfc93a9841b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:20.216080 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2ddf7d1f-1094-48fa-bc30-0dfc93a9841b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:20.216627 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2ddf7d1f-1094-48fa-bc30-0dfc93a9841b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:20.217477 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2ddf7d1f-1094-48fa-bc30-0dfc93a9841b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:20.218024 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2ddf7d1f-1094-48fa-bc30-0dfc93a9841b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:20.218693 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2ddf7d1f-1094-48fa-bc30-0dfc93a9841b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:20.257030 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2ddf7d1f-1094-48fa-bc30-0dfc93a9841b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:20.257679 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2ddf7d1f-1094-48fa-bc30-0dfc93a9841b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:20.258404 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2ddf7d1f-1094-48fa-bc30-0dfc93a9841b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:20.259099 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.objects.instance [None req-2ddf7d1f-1094-48fa-bc30-0dfc93a9841b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lazy-loading 'fault' on Instance uuid 12cfe47d-e76d-4318-b163-eacbda0af541 {{(pid=132076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 03:52:20.279916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-b65c459b-dd34-4fff-9a47-0f3055142af3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:20.290005 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-b65c459b-dd34-4fff-9a47-0f3055142af3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:20.291438 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-b65c459b-dd34-4fff-9a47-0f3055142af3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:20.292651 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-b65c459b-dd34-4fff-9a47-0f3055142af3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1808 microversion: 2.20 time: 0.185996 Sep 03 03:52:20.293652 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 242/486] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:52:20 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:52:20.310548 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-2ddf7d1f-1094-48fa-bc30-0dfc93a9841b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0647075204ba183fb1e5beb2c5930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bafae6685e248d2ac4fab672648e941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:20.318285 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-2ddf7d1f-1094-48fa-bc30-0dfc93a9841b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541" status: 200 len: 1309 microversion: 2.1 time: 0.119369 Sep 03 03:52:20.318827 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 245/487] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:20 2022] GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541 => generated 1309 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:20.985941 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-d3fa91b8-a4c1-4f5c-8cf0-e9356200a9c3 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:20.986630 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-d3fa91b8-a4c1-4f5c-8cf0-e9356200a9c3 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:20.992831 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d3fa91b8-a4c1-4f5c-8cf0-e9356200a9c3 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:20.993345 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d3fa91b8-a4c1-4f5c-8cf0-e9356200a9c3 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:20.993845 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d3fa91b8-a4c1-4f5c-8cf0-e9356200a9c3 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:20.994599 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d3fa91b8-a4c1-4f5c-8cf0-e9356200a9c3 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:20.995117 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d3fa91b8-a4c1-4f5c-8cf0-e9356200a9c3 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:20.995572 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d3fa91b8-a4c1-4f5c-8cf0-e9356200a9c3 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:21.064146 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-d3fa91b8-a4c1-4f5c-8cf0-e9356200a9c3 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:21.076431 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-d3fa91b8-a4c1-4f5c-8cf0-e9356200a9c3 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1185 microversion: 2.1 time: 0.094566 Sep 03 03:52:21.077204 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 243/488] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:20 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:21.318087 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-17506317-21b2-4abb-866f-d721f4629f02 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:21.318610 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-17506317-21b2-4abb-866f-d721f4629f02 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:21.325408 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-17506317-21b2-4abb-866f-d721f4629f02 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:21.325888 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-17506317-21b2-4abb-866f-d721f4629f02 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:21.326319 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-17506317-21b2-4abb-866f-d721f4629f02 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:21.327065 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-17506317-21b2-4abb-866f-d721f4629f02 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:21.327540 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-17506317-21b2-4abb-866f-d721f4629f02 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:21.327932 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-17506317-21b2-4abb-866f-d721f4629f02 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:21.343145 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-e5a7be66-26bf-431e-9c3b-751bfc8e6eda tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:21.344419 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-e5a7be66-26bf-431e-9c3b-751bfc8e6eda tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 12cfe47d-e76d-4318-b163-eacbda0af541] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:21.352865 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e5a7be66-26bf-431e-9c3b-751bfc8e6eda tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:21.353558 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e5a7be66-26bf-431e-9c3b-751bfc8e6eda tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:21.354130 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e5a7be66-26bf-431e-9c3b-751bfc8e6eda tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:21.355062 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e5a7be66-26bf-431e-9c3b-751bfc8e6eda tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:21.355650 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e5a7be66-26bf-431e-9c3b-751bfc8e6eda tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:21.356235 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e5a7be66-26bf-431e-9c3b-751bfc8e6eda tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:21.392224 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e5a7be66-26bf-431e-9c3b-751bfc8e6eda tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:21.392859 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e5a7be66-26bf-431e-9c3b-751bfc8e6eda tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:21.393484 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e5a7be66-26bf-431e-9c3b-751bfc8e6eda tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:21.393933 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.objects.instance [None req-e5a7be66-26bf-431e-9c3b-751bfc8e6eda tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lazy-loading 'fault' on Instance uuid 12cfe47d-e76d-4318-b163-eacbda0af541 {{(pid=132077) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 03:52:21.456125 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-e5a7be66-26bf-431e-9c3b-751bfc8e6eda tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0647075204ba183fb1e5beb2c5930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bafae6685e248d2ac4fab672648e941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:21.467000 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-e5a7be66-26bf-431e-9c3b-751bfc8e6eda tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541" status: 200 len: 1309 microversion: 2.1 time: 0.128504 Sep 03 03:52:21.467566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 244/489] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:21 2022] GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541 => generated 1309 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:21.500381 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-17506317-21b2-4abb-866f-d721f4629f02 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:21.509504 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-17506317-21b2-4abb-866f-d721f4629f02 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:21.510884 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-17506317-21b2-4abb-866f-d721f4629f02 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:21.512235 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-17506317-21b2-4abb-866f-d721f4629f02 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1808 microversion: 2.20 time: 0.198161 Sep 03 03:52:21.512731 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 246/490] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:52:21 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:52:22.101849 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-24996965-826b-4360-9c96-7d84c5f4734a tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:22.102446 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-24996965-826b-4360-9c96-7d84c5f4734a tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:22.109611 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-24996965-826b-4360-9c96-7d84c5f4734a tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:22.110175 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-24996965-826b-4360-9c96-7d84c5f4734a tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:22.110706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-24996965-826b-4360-9c96-7d84c5f4734a tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:22.111686 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-24996965-826b-4360-9c96-7d84c5f4734a tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:22.112312 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-24996965-826b-4360-9c96-7d84c5f4734a tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:22.112758 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-24996965-826b-4360-9c96-7d84c5f4734a tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:22.174912 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-24996965-826b-4360-9c96-7d84c5f4734a tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:22.182617 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-24996965-826b-4360-9c96-7d84c5f4734a tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1203 microversion: 2.1 time: 0.084763 Sep 03 03:52:22.183278 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 245/491] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:22 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1203 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:22.490470 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-f1dba64b-187e-4fd3-bcd4-e07bf586b005 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:22.491182 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-f1dba64b-187e-4fd3-bcd4-e07bf586b005 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 12cfe47d-e76d-4318-b163-eacbda0af541] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:22.497864 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f1dba64b-187e-4fd3-bcd4-e07bf586b005 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:22.498340 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f1dba64b-187e-4fd3-bcd4-e07bf586b005 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:22.499081 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f1dba64b-187e-4fd3-bcd4-e07bf586b005 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:22.499829 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f1dba64b-187e-4fd3-bcd4-e07bf586b005 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:22.500270 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f1dba64b-187e-4fd3-bcd4-e07bf586b005 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:22.500714 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f1dba64b-187e-4fd3-bcd4-e07bf586b005 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:22.515819 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.wsgi [None req-f1dba64b-187e-4fd3-bcd4-e07bf586b005 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] HTTP exception thrown: Instance 12cfe47d-e76d-4318-b163-eacbda0af541 could not be found. Sep 03 03:52:22.517864 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-f1dba64b-187e-4fd3-bcd4-e07bf586b005 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Request method failure captured: Sep 03 03:52:22.517864 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: request: GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541 HTTP/1.1 Sep 03 03:52:22.517864 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept: application/json Sep 03 03:52:22.517864 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept-Encoding: identity Sep 03 03:52:22.517864 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Connection: close Sep 03 03:52:22.517864 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Length: 0 Sep 03 03:52:22.517864 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Type: application/json Sep 03 03:52:22.517864 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Host: 10.222.0.25 Sep 03 03:52:22.517864 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Openstack-System-Scope: None Sep 03 03:52:22.517864 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: User-Agent: python-urllib3/1.26.12 Sep 03 03:52:22.517864 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Auth-Token: gAAAAABjEs8hbDWav-6BAuZxYhUx8lLgsThpZdjEyVVZvwjvbSnyTWlUsvQTr76vsg5WwId-bBDh_fTkHJVDP4Yj6SDe7MhedV5tsLweSsGFbU3PePOYHw4tDQtfl69uLA8HhGgUpmysYePJWaP7uReNdRuy98PzoQU4UlBV38gGpq12kVQ5PVc Sep 03 03:52:22.517864 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Id: None Sep 03 03:52:22.517864 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Name: None Sep 03 03:52:22.517864 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Identity-Status: Confirmed Sep 03 03:52:22.517864 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Is-Admin-Project: True Sep 03 03:52:22.517864 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Id: default Sep 03 03:52:22.517864 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Name: Default Sep 03 03:52:22.517864 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Id: 6bafae6685e248d2ac4fab672648e941 Sep 03 03:52:22.517864 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1874783988 Sep 03 03:52:22.517864 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Role: member,reader Sep 03 03:52:22.517864 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Roles: member,reader Sep 03 03:52:22.519494 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6bafae6685e248d2ac4fab672648e941"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6bafae6685e248d2ac4fab672648e941"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6bafae6685e248d2ac4fab672648e941"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6bafae6685e248d2ac4fab672648e941"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:52:22.519494 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant: tempest-VolumesSnapshotTestJSON-1874783988 Sep 03 03:52:22.519494 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Id: 6bafae6685e248d2ac4fab672648e941 Sep 03 03:52:22.519494 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1874783988 Sep 03 03:52:22.519494 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User: tempest-VolumesSnapshotTestJSON-1874783988-project Sep 03 03:52:22.519494 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Id: default Sep 03 03:52:22.519494 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Name: Default Sep 03 03:52:22.519494 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Id: 09f0647075204ba183fb1e5beb2c5930 Sep 03 03:52:22.519494 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Name: tempest-VolumesSnapshotTestJSON-1874783988-project Sep 03 03:52:22.519494 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: method: > Sep 03 03:52:22.519494 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: exception: Instance 12cfe47d-e76d-4318-b163-eacbda0af541 could not be found. Sep 03 03:52:22.519494 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: action_args: {'id': '12cfe47d-e76d-4318-b163-eacbda0af541'} Sep 03 03:52:22.520504 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:52:22.520504 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:52:22.520504 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 03:52:22.520504 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 03:52:22.520504 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 03:52:22.520504 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 03:52:22.520504 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 03:52:22.520504 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 03:52:22.520504 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 03:52:22.520504 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 03:52:22.520504 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12cfe47d-e76d-4318-b163-eacbda0af541 could not be found. Sep 03 03:52:22.520504 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:52:22.520504 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:52:22.520504 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:52:22.520504 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:52:22.520504 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:52:22.520504 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:52:22.520504 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:52:22.520504 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:52:22.520504 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:52:22.521985 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:52:22.521985 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 03:52:22.521985 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 03:52:22.521985 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 03:52:22.521985 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 03:52:22.521985 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 03:52:22.521985 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:52:22.521985 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12cfe47d-e76d-4318-b163-eacbda0af541 could not be found. Sep 03 03:52:22.521985 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:52:22.521985 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:52:22.521985 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:52:22.521985 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:52:22.521985 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:52:22.521985 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:52:22.521985 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:52:22.521985 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:52:22.521985 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12cfe47d-e76d-4318-b163-eacbda0af541 could not be found. Sep 03 03:52:22.521985 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:52:22.524036 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-f1dba64b-187e-4fd3-bcd4-e07bf586b005 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Returning 404 to user: Instance 12cfe47d-e76d-4318-b163-eacbda0af541 could not be found. {{(pid=132076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:52:22.525113 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-f1dba64b-187e-4fd3-bcd4-e07bf586b005 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541" status: 404 len: 111 microversion: 2.1 time: 0.038521 Sep 03 03:52:22.526097 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 247/492] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:22 2022] GET /compute/v2.1/servers/12cfe47d-e76d-4318-b163-eacbda0af541 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 03:52:22.543418 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-d7a0fd50-8df8-44b9-a4e0-7cbbaeef530f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:22.544795 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-d7a0fd50-8df8-44b9-a4e0-7cbbaeef530f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:22.552562 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d7a0fd50-8df8-44b9-a4e0-7cbbaeef530f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:22.553179 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d7a0fd50-8df8-44b9-a4e0-7cbbaeef530f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:22.553679 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d7a0fd50-8df8-44b9-a4e0-7cbbaeef530f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:22.554446 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d7a0fd50-8df8-44b9-a4e0-7cbbaeef530f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:22.555369 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d7a0fd50-8df8-44b9-a4e0-7cbbaeef530f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:22.556125 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d7a0fd50-8df8-44b9-a4e0-7cbbaeef530f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:22.583223 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:52:22.708766 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-d7a0fd50-8df8-44b9-a4e0-7cbbaeef530f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:22.718205 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-d7a0fd50-8df8-44b9-a4e0-7cbbaeef530f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:22.719733 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-d7a0fd50-8df8-44b9-a4e0-7cbbaeef530f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:22.720911 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-d7a0fd50-8df8-44b9-a4e0-7cbbaeef530f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1808 microversion: 2.20 time: 0.184350 Sep 03 03:52:22.721647 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 246/493] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:52:22 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:52:23.205771 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-3dc75a82-ae77-4ad2-9969-0367aad3c7fb tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:23.206313 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-3dc75a82-ae77-4ad2-9969-0367aad3c7fb tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:23.212688 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3dc75a82-ae77-4ad2-9969-0367aad3c7fb tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:23.213157 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3dc75a82-ae77-4ad2-9969-0367aad3c7fb tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:23.213612 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3dc75a82-ae77-4ad2-9969-0367aad3c7fb tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:23.214310 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3dc75a82-ae77-4ad2-9969-0367aad3c7fb tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:23.214944 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3dc75a82-ae77-4ad2-9969-0367aad3c7fb tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:23.215365 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3dc75a82-ae77-4ad2-9969-0367aad3c7fb tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:23.443095 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-3dc75a82-ae77-4ad2-9969-0367aad3c7fb tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:23.451439 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-3dc75a82-ae77-4ad2-9969-0367aad3c7fb tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1258 microversion: 2.1 time: 0.249663 Sep 03 03:52:23.451992 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 248/494] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:23 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1258 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:23.544172 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-78ad48e9-b835-4ac8-8ea6-8deefd0d27d6 req-e379cb93-5094-4784-b85d-9e6661d78bbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af98ca5b-174f-43f9-a582-af6ad3342b87", "tag": "60723675-08fc-443b-9199-a4d4fdaeb719"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:52:23.555356 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-78ad48e9-b835-4ac8-8ea6-8deefd0d27d6 req-e379cb93-5094-4784-b85d-9e6661d78bbf service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:23.555839 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-78ad48e9-b835-4ac8-8ea6-8deefd0d27d6 req-e379cb93-5094-4784-b85d-9e6661d78bbf service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:23.556259 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-78ad48e9-b835-4ac8-8ea6-8deefd0d27d6 req-e379cb93-5094-4784-b85d-9e6661d78bbf service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:23.567254 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-78ad48e9-b835-4ac8-8ea6-8deefd0d27d6 req-e379cb93-5094-4784-b85d-9e6661d78bbf service nova] Creating event network-changed:60723675-08fc-443b-9199-a4d4fdaeb719 for instance af98ca5b-174f-43f9-a582-af6ad3342b87 on hv-cinder-79966 Sep 03 03:52:23.572241 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-78ad48e9-b835-4ac8-8ea6-8deefd0d27d6 req-e379cb93-5094-4784-b85d-9e6661d78bbf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031799 Sep 03 03:52:23.572800 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 247/495] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:52:23.747506 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-2b7387f1-720f-4141-ba91-41e18754d40b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:23.748188 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-2b7387f1-720f-4141-ba91-41e18754d40b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:23.756424 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2b7387f1-720f-4141-ba91-41e18754d40b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:23.756981 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2b7387f1-720f-4141-ba91-41e18754d40b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:23.757423 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2b7387f1-720f-4141-ba91-41e18754d40b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:23.758118 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2b7387f1-720f-4141-ba91-41e18754d40b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:23.758571 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2b7387f1-720f-4141-ba91-41e18754d40b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:23.759024 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2b7387f1-720f-4141-ba91-41e18754d40b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:23.896646 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-2b7387f1-720f-4141-ba91-41e18754d40b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:23.905750 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-2b7387f1-720f-4141-ba91-41e18754d40b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:23.907245 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-2b7387f1-720f-4141-ba91-41e18754d40b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:23.908403 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-2b7387f1-720f-4141-ba91-41e18754d40b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1808 microversion: 2.20 time: 0.165604 Sep 03 03:52:23.908959 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 249/496] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:52:23 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:52:24.476254 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-1aab42e3-f471-4178-88c8-9e63b270a69a tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:24.476966 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-1aab42e3-f471-4178-88c8-9e63b270a69a tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:24.483617 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1aab42e3-f471-4178-88c8-9e63b270a69a tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:24.484087 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1aab42e3-f471-4178-88c8-9e63b270a69a tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:24.484506 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1aab42e3-f471-4178-88c8-9e63b270a69a tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:24.485182 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1aab42e3-f471-4178-88c8-9e63b270a69a tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:24.485624 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1aab42e3-f471-4178-88c8-9e63b270a69a tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:24.486032 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1aab42e3-f471-4178-88c8-9e63b270a69a tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:24.640058 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-1aab42e3-f471-4178-88c8-9e63b270a69a tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:24.648278 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-1aab42e3-f471-4178-88c8-9e63b270a69a tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1258 microversion: 2.1 time: 0.177262 Sep 03 03:52:24.648806 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 248/497] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:24 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1258 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:24.937414 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-8e749af5-fb53-4a69-a182-f2f75cf51e2d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:24.938467 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-8e749af5-fb53-4a69-a182-f2f75cf51e2d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:24.950053 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8e749af5-fb53-4a69-a182-f2f75cf51e2d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:24.950988 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8e749af5-fb53-4a69-a182-f2f75cf51e2d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:24.951808 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8e749af5-fb53-4a69-a182-f2f75cf51e2d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:24.953066 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8e749af5-fb53-4a69-a182-f2f75cf51e2d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:24.953880 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8e749af5-fb53-4a69-a182-f2f75cf51e2d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:24.954643 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8e749af5-fb53-4a69-a182-f2f75cf51e2d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:25.102297 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-8e749af5-fb53-4a69-a182-f2f75cf51e2d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:25.111631 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-8e749af5-fb53-4a69-a182-f2f75cf51e2d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:25.113064 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-8e749af5-fb53-4a69-a182-f2f75cf51e2d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:25.114210 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-8e749af5-fb53-4a69-a182-f2f75cf51e2d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1808 microversion: 2.20 time: 0.183275 Sep 03 03:52:25.114736 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 250/498] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:52:24 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:52:25.676859 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-79bb7518-8f44-4257-87e1-9cdce694e831 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:25.677584 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-79bb7518-8f44-4257-87e1-9cdce694e831 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:25.684333 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-79bb7518-8f44-4257-87e1-9cdce694e831 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:25.684818 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-79bb7518-8f44-4257-87e1-9cdce694e831 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:25.685260 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-79bb7518-8f44-4257-87e1-9cdce694e831 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:25.686054 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-79bb7518-8f44-4257-87e1-9cdce694e831 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:25.686525 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-79bb7518-8f44-4257-87e1-9cdce694e831 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:25.686975 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-79bb7518-8f44-4257-87e1-9cdce694e831 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:25.824771 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-79bb7518-8f44-4257-87e1-9cdce694e831 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:25.834063 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-79bb7518-8f44-4257-87e1-9cdce694e831 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1258 microversion: 2.1 time: 0.161880 Sep 03 03:52:25.834733 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 249/499] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:25 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:25.998872 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-8f648346-5579-4e11-a286-7b1ade500ee5 req-82b8933a-3b2d-49fe-bd98-1568da6c173b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d61f1c-d865-4d0d-89a9-1f91f0f8bf78", "name": "network-vif-plugged", "status": "completed", "tag": "dc502e70-8b66-4849-929e-0879ed88e591"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:52:26.010247 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-8f648346-5579-4e11-a286-7b1ade500ee5 req-82b8933a-3b2d-49fe-bd98-1568da6c173b service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:26.010967 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-8f648346-5579-4e11-a286-7b1ade500ee5 req-82b8933a-3b2d-49fe-bd98-1568da6c173b service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:26.011453 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-8f648346-5579-4e11-a286-7b1ade500ee5 req-82b8933a-3b2d-49fe-bd98-1568da6c173b service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:26.024222 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-8f648346-5579-4e11-a286-7b1ade500ee5 req-82b8933a-3b2d-49fe-bd98-1568da6c173b service nova] Creating event network-vif-plugged:dc502e70-8b66-4849-929e-0879ed88e591 for instance 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 on hv-cinder-79966 Sep 03 03:52:26.029135 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-8f648346-5579-4e11-a286-7b1ade500ee5 req-82b8933a-3b2d-49fe-bd98-1568da6c173b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034181 Sep 03 03:52:26.029709 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 251/500] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:52:26.138575 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-a0735944-5f29-4e4d-8c96-822fe941e28d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:26.139199 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-a0735944-5f29-4e4d-8c96-822fe941e28d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:26.145440 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a0735944-5f29-4e4d-8c96-822fe941e28d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:26.145926 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a0735944-5f29-4e4d-8c96-822fe941e28d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:26.146381 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a0735944-5f29-4e4d-8c96-822fe941e28d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:26.147204 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a0735944-5f29-4e4d-8c96-822fe941e28d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:26.147654 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a0735944-5f29-4e4d-8c96-822fe941e28d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:26.148072 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a0735944-5f29-4e4d-8c96-822fe941e28d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:26.284403 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a0735944-5f29-4e4d-8c96-822fe941e28d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:26.293923 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a0735944-5f29-4e4d-8c96-822fe941e28d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:26.295437 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a0735944-5f29-4e4d-8c96-822fe941e28d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:26.296598 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-a0735944-5f29-4e4d-8c96-822fe941e28d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1808 microversion: 2.20 time: 0.161891 Sep 03 03:52:26.297170 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 250/501] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:52:26 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:52:26.862868 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-71a846bf-6104-4a1e-a67b-4d4513a2bc3e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:26.864021 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-71a846bf-6104-4a1e-a67b-4d4513a2bc3e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:26.874468 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-71a846bf-6104-4a1e-a67b-4d4513a2bc3e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:26.875287 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-71a846bf-6104-4a1e-a67b-4d4513a2bc3e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:26.875996 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-71a846bf-6104-4a1e-a67b-4d4513a2bc3e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:26.877134 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-71a846bf-6104-4a1e-a67b-4d4513a2bc3e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:26.877881 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-71a846bf-6104-4a1e-a67b-4d4513a2bc3e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:26.878569 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-71a846bf-6104-4a1e-a67b-4d4513a2bc3e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:26.899028 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell1:SELECT=100 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:52:27.020987 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-71a846bf-6104-4a1e-a67b-4d4513a2bc3e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:27.029033 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-71a846bf-6104-4a1e-a67b-4d4513a2bc3e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1258 microversion: 2.1 time: 0.174162 Sep 03 03:52:27.029594 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 252/502] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:26 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1258 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:27.323396 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-8177a8ee-c46f-4b11-b08f-11e4300cf9f3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:27.323960 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-8177a8ee-c46f-4b11-b08f-11e4300cf9f3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:27.330966 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8177a8ee-c46f-4b11-b08f-11e4300cf9f3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:27.331438 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8177a8ee-c46f-4b11-b08f-11e4300cf9f3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:27.331864 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8177a8ee-c46f-4b11-b08f-11e4300cf9f3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:27.332537 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8177a8ee-c46f-4b11-b08f-11e4300cf9f3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:27.332976 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8177a8ee-c46f-4b11-b08f-11e4300cf9f3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:27.333382 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8177a8ee-c46f-4b11-b08f-11e4300cf9f3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:27.463004 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-8177a8ee-c46f-4b11-b08f-11e4300cf9f3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:27.472250 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-8177a8ee-c46f-4b11-b08f-11e4300cf9f3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:27.473705 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-8177a8ee-c46f-4b11-b08f-11e4300cf9f3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:27.474940 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-8177a8ee-c46f-4b11-b08f-11e4300cf9f3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1808 microversion: 2.20 time: 0.155508 Sep 03 03:52:27.475504 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 251/503] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:52:27 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:52:28.056456 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-fc3cfa58-50be-4d72-a879-06988f93db88 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:28.057215 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-fc3cfa58-50be-4d72-a879-06988f93db88 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:28.068304 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fc3cfa58-50be-4d72-a879-06988f93db88 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:28.069112 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fc3cfa58-50be-4d72-a879-06988f93db88 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:28.069832 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fc3cfa58-50be-4d72-a879-06988f93db88 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:28.071023 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fc3cfa58-50be-4d72-a879-06988f93db88 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:28.071663 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fc3cfa58-50be-4d72-a879-06988f93db88 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:28.072374 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fc3cfa58-50be-4d72-a879-06988f93db88 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:28.216851 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-fc3cfa58-50be-4d72-a879-06988f93db88 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:28.224751 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-fc3cfa58-50be-4d72-a879-06988f93db88 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1258 microversion: 2.1 time: 0.175149 Sep 03 03:52:28.225486 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 253/504] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:28 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1258 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:28.503769 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-55ddd7e2-487c-4fb0-9d13-1970fb5441f6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:28.504385 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-55ddd7e2-487c-4fb0-9d13-1970fb5441f6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:28.512052 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-55ddd7e2-487c-4fb0-9d13-1970fb5441f6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:28.512604 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-55ddd7e2-487c-4fb0-9d13-1970fb5441f6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:28.513100 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-55ddd7e2-487c-4fb0-9d13-1970fb5441f6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:28.513971 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-55ddd7e2-487c-4fb0-9d13-1970fb5441f6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:28.514486 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-55ddd7e2-487c-4fb0-9d13-1970fb5441f6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:28.515026 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-55ddd7e2-487c-4fb0-9d13-1970fb5441f6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:28.648505 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-55ddd7e2-487c-4fb0-9d13-1970fb5441f6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:28.657659 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-55ddd7e2-487c-4fb0-9d13-1970fb5441f6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:28.659130 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-55ddd7e2-487c-4fb0-9d13-1970fb5441f6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:28.660290 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-55ddd7e2-487c-4fb0-9d13-1970fb5441f6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1808 microversion: 2.20 time: 0.161298 Sep 03 03:52:28.660842 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 252/505] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:52:28 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:52:29.251599 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-c9d42080-2ba1-439b-a281-c5f016fa347c tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:29.252195 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-c9d42080-2ba1-439b-a281-c5f016fa347c tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:29.259424 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c9d42080-2ba1-439b-a281-c5f016fa347c tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:29.260039 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c9d42080-2ba1-439b-a281-c5f016fa347c tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:29.260612 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c9d42080-2ba1-439b-a281-c5f016fa347c tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:29.261517 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c9d42080-2ba1-439b-a281-c5f016fa347c tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:29.262034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c9d42080-2ba1-439b-a281-c5f016fa347c tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:29.262612 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c9d42080-2ba1-439b-a281-c5f016fa347c tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:29.396177 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-c9d42080-2ba1-439b-a281-c5f016fa347c tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:29.404430 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-c9d42080-2ba1-439b-a281-c5f016fa347c tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1258 microversion: 2.1 time: 0.158544 Sep 03 03:52:29.404990 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 254/506] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:29 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:29.688514 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-6cec8526-aa14-4855-8c4e-a3d723e58e38 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:29.689158 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-6cec8526-aa14-4855-8c4e-a3d723e58e38 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:29.691675 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell0:SELECT=2 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:52:29.697514 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6cec8526-aa14-4855-8c4e-a3d723e58e38 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:29.697982 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6cec8526-aa14-4855-8c4e-a3d723e58e38 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:29.698407 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6cec8526-aa14-4855-8c4e-a3d723e58e38 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:29.699115 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6cec8526-aa14-4855-8c4e-a3d723e58e38 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:29.699556 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6cec8526-aa14-4855-8c4e-a3d723e58e38 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:29.699966 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6cec8526-aa14-4855-8c4e-a3d723e58e38 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:29.700540 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell0:SELECT=6 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:52:29.840451 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-6cec8526-aa14-4855-8c4e-a3d723e58e38 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:29.849028 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-6cec8526-aa14-4855-8c4e-a3d723e58e38 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:29.850534 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-6cec8526-aa14-4855-8c4e-a3d723e58e38 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:29.851694 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-6cec8526-aa14-4855-8c4e-a3d723e58e38 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1808 microversion: 2.20 time: 0.167746 Sep 03 03:52:29.852247 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 253/507] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:52:29 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:52:30.431176 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-b15d2c25-4cb7-4610-8d7a-1ca17c75b1ef tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:30.432170 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-b15d2c25-4cb7-4610-8d7a-1ca17c75b1ef tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:30.435293 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell0:SELECT=2 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:52:30.444682 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b15d2c25-4cb7-4610-8d7a-1ca17c75b1ef tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:30.445155 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b15d2c25-4cb7-4610-8d7a-1ca17c75b1ef tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:30.445587 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b15d2c25-4cb7-4610-8d7a-1ca17c75b1ef tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:30.446249 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b15d2c25-4cb7-4610-8d7a-1ca17c75b1ef tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:30.446688 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b15d2c25-4cb7-4610-8d7a-1ca17c75b1ef tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:30.447141 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b15d2c25-4cb7-4610-8d7a-1ca17c75b1ef tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:30.587316 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-b15d2c25-4cb7-4610-8d7a-1ca17c75b1ef tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:30.595822 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-b15d2c25-4cb7-4610-8d7a-1ca17c75b1ef tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1258 microversion: 2.1 time: 0.171129 Sep 03 03:52:30.596380 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 255/508] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:30 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1258 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:30.881559 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-3793c5b0-fe36-4e6d-9136-c943665eb225 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:30.882415 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-3793c5b0-fe36-4e6d-9136-c943665eb225 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:30.886023 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:52:30.895393 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3793c5b0-fe36-4e6d-9136-c943665eb225 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:30.896168 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3793c5b0-fe36-4e6d-9136-c943665eb225 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:30.896873 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3793c5b0-fe36-4e6d-9136-c943665eb225 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:30.897926 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3793c5b0-fe36-4e6d-9136-c943665eb225 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:30.898373 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3793c5b0-fe36-4e6d-9136-c943665eb225 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:30.898780 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3793c5b0-fe36-4e6d-9136-c943665eb225 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:31.036392 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-3793c5b0-fe36-4e6d-9136-c943665eb225 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:31.047521 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-3793c5b0-fe36-4e6d-9136-c943665eb225 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:31.048936 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-3793c5b0-fe36-4e6d-9136-c943665eb225 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:31.050108 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-3793c5b0-fe36-4e6d-9136-c943665eb225 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1808 microversion: 2.20 time: 0.175119 Sep 03 03:52:31.050691 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 254/509] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:52:30 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:52:31.508266 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-e67b99fa-4c75-4a45-9d13-2024c9d261c0 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1184700826", "imageRef": "0af209bb-870a-4343-a9f9-de05883bb8dd", "flavorRef": "452", "networks": [{"uuid": "8a12f613-319d-4585-b281-a9de8d8e8976"}]}} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:52:31.574608 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.network.neutron [None req-e67b99fa-4c75-4a45-9d13-2024c9d261c0 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] validate_networks() for [('8a12f613-319d-4585-b281-a9de8d8e8976', None, None, None, None, None)] {{(pid=132076) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 03:52:31.619373 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-a1b12f64-0baa-477d-b163-2af9ea400624 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:31.620102 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-a1b12f64-0baa-477d-b163-2af9ea400624 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:31.626640 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a1b12f64-0baa-477d-b163-2af9ea400624 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:31.627155 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a1b12f64-0baa-477d-b163-2af9ea400624 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:31.627578 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a1b12f64-0baa-477d-b163-2af9ea400624 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:31.628258 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a1b12f64-0baa-477d-b163-2af9ea400624 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:31.628706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a1b12f64-0baa-477d-b163-2af9ea400624 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:31.629118 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a1b12f64-0baa-477d-b163-2af9ea400624 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:31.771863 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a1b12f64-0baa-477d-b163-2af9ea400624 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:31.780074 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-a1b12f64-0baa-477d-b163-2af9ea400624 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1258 microversion: 2.1 time: 0.164878 Sep 03 03:52:31.780651 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 255/510] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:31 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:31.935642 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-e67b99fa-4c75-4a45-9d13-2024c9d261c0 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Flavor limits 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 03:52:31.936209 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-e67b99fa-4c75-4a45-9d13-2024c9d261c0 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Image limits 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 03:52:31.936893 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-e67b99fa-4c75-4a45-9d13-2024c9d261c0 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Flavor pref 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 03:52:31.937493 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-e67b99fa-4c75-4a45-9d13-2024c9d261c0 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Image pref 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 03:52:31.938121 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-e67b99fa-4c75-4a45-9d13-2024c9d261c0 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 03:52:31.949528 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e67b99fa-4c75-4a45-9d13-2024c9d261c0 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:31.950009 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e67b99fa-4c75-4a45-9d13-2024c9d261c0 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:31.950444 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e67b99fa-4c75-4a45-9d13-2024c9d261c0 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:31.951218 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e67b99fa-4c75-4a45-9d13-2024c9d261c0 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:31.951669 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e67b99fa-4c75-4a45-9d13-2024c9d261c0 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:31.952092 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e67b99fa-4c75-4a45-9d13-2024c9d261c0 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:31.969848 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.quota [None req-e67b99fa-4c75-4a45-9d13-2024c9d261c0 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Getting quotas for project 6bafae6685e248d2ac4fab672648e941. Resources: {'ram', 'instances', 'cores'} {{(pid=132076) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 03:52:31.974342 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.quota [None req-e67b99fa-4c75-4a45-9d13-2024c9d261c0 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Getting quotas for user 09f0647075204ba183fb1e5beb2c5930 and project 6bafae6685e248d2ac4fab672648e941. Resources: {'ram', 'instances', 'cores'} {{(pid=132076) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 03:52:31.987167 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-e67b99fa-4c75-4a45-9d13-2024c9d261c0 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Going to run 1 instances... {{(pid=132076) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 03:52:31.989499 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-e67b99fa-4c75-4a45-9d13-2024c9d261c0 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 4debbf95-0ffb-408e-bc62-12015a742cff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0af209bb-870a-4343-a9f9-de05883bb8dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132076) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 03:52:32.036405 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-e67b99fa-4c75-4a45-9d13-2024c9d261c0 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.531981 Sep 03 03:52:32.037068 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 256/511] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Sep 3 03:52:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 03:52:32.048604 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-eba4f2ce-4b84-4008-9abd-45f0fc6334df tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:32.049203 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-eba4f2ce-4b84-4008-9abd-45f0fc6334df tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 4debbf95-0ffb-408e-bc62-12015a742cff] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:32.075633 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-81aa093e-55ab-4bf1-8664-de12429fb77c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:32.076335 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-81aa093e-55ab-4bf1-8664-de12429fb77c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:32.084150 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-81aa093e-55ab-4bf1-8664-de12429fb77c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:32.084767 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-81aa093e-55ab-4bf1-8664-de12429fb77c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:32.085390 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-81aa093e-55ab-4bf1-8664-de12429fb77c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:32.086224 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-81aa093e-55ab-4bf1-8664-de12429fb77c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:32.086744 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-81aa093e-55ab-4bf1-8664-de12429fb77c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:32.087251 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-81aa093e-55ab-4bf1-8664-de12429fb77c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:32.105072 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-eba4f2ce-4b84-4008-9abd-45f0fc6334df tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0647075204ba183fb1e5beb2c5930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bafae6685e248d2ac4fab672648e941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:32.113021 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-eba4f2ce-4b84-4008-9abd-45f0fc6334df tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "GET /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff" status: 200 len: 1219 microversion: 2.1 time: 0.068356 Sep 03 03:52:32.113891 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 256/512] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:32 2022] GET /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:32.229538 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-81aa093e-55ab-4bf1-8664-de12429fb77c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:32.239993 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-81aa093e-55ab-4bf1-8664-de12429fb77c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:32.241770 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-81aa093e-55ab-4bf1-8664-de12429fb77c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:32.242952 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-81aa093e-55ab-4bf1-8664-de12429fb77c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1795 microversion: 2.20 time: 0.171442 Sep 03 03:52:32.250950 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 257/513] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:52:32 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1795 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:52:32.803536 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-0af94ddf-bbc3-4296-864a-e3f2b7c94548 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:32.804152 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-0af94ddf-bbc3-4296-864a-e3f2b7c94548 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:32.810593 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0af94ddf-bbc3-4296-864a-e3f2b7c94548 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:32.811112 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0af94ddf-bbc3-4296-864a-e3f2b7c94548 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:32.811548 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0af94ddf-bbc3-4296-864a-e3f2b7c94548 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:32.812236 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0af94ddf-bbc3-4296-864a-e3f2b7c94548 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:32.812689 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0af94ddf-bbc3-4296-864a-e3f2b7c94548 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:32.813134 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0af94ddf-bbc3-4296-864a-e3f2b7c94548 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:32.944421 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-0af94ddf-bbc3-4296-864a-e3f2b7c94548 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:32.952698 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-0af94ddf-bbc3-4296-864a-e3f2b7c94548 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1258 microversion: 2.1 time: 0.153138 Sep 03 03:52:32.953261 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 257/514] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:32 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:33.140727 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-6412041c-3f89-4e4f-b72e-f6b656a82d02 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:33.141556 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-6412041c-3f89-4e4f-b72e-f6b656a82d02 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 4debbf95-0ffb-408e-bc62-12015a742cff] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:33.150701 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6412041c-3f89-4e4f-b72e-f6b656a82d02 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:33.151214 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6412041c-3f89-4e4f-b72e-f6b656a82d02 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:33.151641 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6412041c-3f89-4e4f-b72e-f6b656a82d02 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:33.152316 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6412041c-3f89-4e4f-b72e-f6b656a82d02 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:33.152757 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6412041c-3f89-4e4f-b72e-f6b656a82d02 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:33.153166 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6412041c-3f89-4e4f-b72e-f6b656a82d02 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:33.223195 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-6412041c-3f89-4e4f-b72e-f6b656a82d02 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0647075204ba183fb1e5beb2c5930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bafae6685e248d2ac4fab672648e941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:33.231135 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-6412041c-3f89-4e4f-b72e-f6b656a82d02 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "GET /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff" status: 200 len: 1271 microversion: 2.1 time: 0.097067 Sep 03 03:52:33.231695 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 258/515] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:33 2022] GET /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff => generated 1271 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:33.951928 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-bb0ec0e3-582d-4c19-bc4b-bf3ce7793efc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1fc6664-e084-4952-b7af-ebe490548b8f"}} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:52:33.954426 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-bb0ec0e3-582d-4c19-bc4b-bf3ce7793efc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:33.961600 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bb0ec0e3-582d-4c19-bc4b-bf3ce7793efc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:33.962069 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bb0ec0e3-582d-4c19-bc4b-bf3ce7793efc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:33.962491 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bb0ec0e3-582d-4c19-bc4b-bf3ce7793efc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:33.963217 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bb0ec0e3-582d-4c19-bc4b-bf3ce7793efc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:33.963666 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bb0ec0e3-582d-4c19-bc4b-bf3ce7793efc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:33.964051 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bb0ec0e3-582d-4c19-bc4b-bf3ce7793efc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:33.975979 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-0d7124e8-5ba3-4bd3-8cff-29dcdd8e1374 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:33.976648 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-0d7124e8-5ba3-4bd3-8cff-29dcdd8e1374 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:33.984085 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0d7124e8-5ba3-4bd3-8cff-29dcdd8e1374 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:33.984253 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0d7124e8-5ba3-4bd3-8cff-29dcdd8e1374 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:33.984636 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0d7124e8-5ba3-4bd3-8cff-29dcdd8e1374 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:33.985415 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0d7124e8-5ba3-4bd3-8cff-29dcdd8e1374 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:33.985862 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0d7124e8-5ba3-4bd3-8cff-29dcdd8e1374 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:33.986281 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0d7124e8-5ba3-4bd3-8cff-29dcdd8e1374 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:34.140562 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-0d7124e8-5ba3-4bd3-8cff-29dcdd8e1374 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:34.149877 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-0d7124e8-5ba3-4bd3-8cff-29dcdd8e1374 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1258 microversion: 2.1 time: 0.177823 Sep 03 03:52:34.150583 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 259/516] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:33 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1258 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:34.257585 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-abdc57f1-9603-4ad6-ab27-6b1d52d932de tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:34.258980 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-abdc57f1-9603-4ad6-ab27-6b1d52d932de tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 4debbf95-0ffb-408e-bc62-12015a742cff] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:34.266285 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-abdc57f1-9603-4ad6-ab27-6b1d52d932de tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:34.267042 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-abdc57f1-9603-4ad6-ab27-6b1d52d932de tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:34.267802 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-abdc57f1-9603-4ad6-ab27-6b1d52d932de tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:34.268591 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-abdc57f1-9603-4ad6-ab27-6b1d52d932de tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:34.269098 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-abdc57f1-9603-4ad6-ab27-6b1d52d932de tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:34.269611 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-abdc57f1-9603-4ad6-ab27-6b1d52d932de tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:34.333619 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-bb0ec0e3-582d-4c19-bc4b-bf3ce7793efc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "POST /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.385533 Sep 03 03:52:34.334236 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 258/517] 10.222.0.25 () {60 vars in 1323 bytes} [Sat Sep 3 03:52:33 2022] POST /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2/os-volume_attachments => generated 194 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:52:34.366222 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-abdc57f1-9603-4ad6-ab27-6b1d52d932de tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0647075204ba183fb1e5beb2c5930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bafae6685e248d2ac4fab672648e941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:34.377641 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-abdc57f1-9603-4ad6-ab27-6b1d52d932de tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "GET /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff" status: 200 len: 1279 microversion: 2.1 time: 0.125848 Sep 03 03:52:34.388417 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 260/518] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:34 2022] GET /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff => generated 1279 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:35.177999 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-1389fdda-4e73-447e-bfe9-10594961671b tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:35.178565 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-1389fdda-4e73-447e-bfe9-10594961671b tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:35.184918 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1389fdda-4e73-447e-bfe9-10594961671b tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:35.185402 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1389fdda-4e73-447e-bfe9-10594961671b tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:35.185933 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1389fdda-4e73-447e-bfe9-10594961671b tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:35.186659 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1389fdda-4e73-447e-bfe9-10594961671b tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:35.187124 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1389fdda-4e73-447e-bfe9-10594961671b tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:35.187547 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1389fdda-4e73-447e-bfe9-10594961671b tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:35.324495 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-1389fdda-4e73-447e-bfe9-10594961671b tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:35.332647 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-1389fdda-4e73-447e-bfe9-10594961671b tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1258 microversion: 2.1 time: 0.159478 Sep 03 03:52:35.333235 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 259/519] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:35 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:35.403746 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-781a8b64-894c-49c3-a4ac-828b4bd7209b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:35.404431 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-781a8b64-894c-49c3-a4ac-828b4bd7209b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 4debbf95-0ffb-408e-bc62-12015a742cff] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:35.411590 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-781a8b64-894c-49c3-a4ac-828b4bd7209b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:35.412083 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-781a8b64-894c-49c3-a4ac-828b4bd7209b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:35.412512 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-781a8b64-894c-49c3-a4ac-828b4bd7209b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:35.413209 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-781a8b64-894c-49c3-a4ac-828b4bd7209b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:35.413661 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-781a8b64-894c-49c3-a4ac-828b4bd7209b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:35.414079 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-781a8b64-894c-49c3-a4ac-828b4bd7209b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:35.830076 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-781a8b64-894c-49c3-a4ac-828b4bd7209b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0647075204ba183fb1e5beb2c5930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bafae6685e248d2ac4fab672648e941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:35.838207 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-781a8b64-894c-49c3-a4ac-828b4bd7209b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "GET /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff" status: 200 len: 1319 microversion: 2.1 time: 0.438440 Sep 03 03:52:35.850900 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 261/520] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:35 2022] GET /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff => generated 1319 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:35.905475 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-8ed91f9c-169d-4c27-a6cd-35c68d75db68 req-26f8f0aa-a43b-47c7-986e-56f8cb4ac8c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4debbf95-0ffb-408e-bc62-12015a742cff", "tag": "c369599b-8063-4d16-b7ee-03c9e0bbb2e5"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:52:35.917233 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-8ed91f9c-169d-4c27-a6cd-35c68d75db68 req-26f8f0aa-a43b-47c7-986e-56f8cb4ac8c1 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:35.918103 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-8ed91f9c-169d-4c27-a6cd-35c68d75db68 req-26f8f0aa-a43b-47c7-986e-56f8cb4ac8c1 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:35.918894 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-8ed91f9c-169d-4c27-a6cd-35c68d75db68 req-26f8f0aa-a43b-47c7-986e-56f8cb4ac8c1 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:35.931537 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-8ed91f9c-169d-4c27-a6cd-35c68d75db68 req-26f8f0aa-a43b-47c7-986e-56f8cb4ac8c1 service nova] Creating event network-changed:c369599b-8063-4d16-b7ee-03c9e0bbb2e5 for instance 4debbf95-0ffb-408e-bc62-12015a742cff on hv-cinder-79966 Sep 03 03:52:35.936787 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-8ed91f9c-169d-4c27-a6cd-35c68d75db68 req-26f8f0aa-a43b-47c7-986e-56f8cb4ac8c1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036097 Sep 03 03:52:35.937608 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 260/521] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:52:36.005330 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-98d4ba73-6b58-4b55-907b-c8c66df87577 req-d5cb5fe0-06b0-46ac-81b1-5f5d3933f66e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af98ca5b-174f-43f9-a582-af6ad3342b87", "name": "network-vif-plugged", "status": "completed", "tag": "60723675-08fc-443b-9199-a4d4fdaeb719"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:52:36.015220 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-98d4ba73-6b58-4b55-907b-c8c66df87577 req-d5cb5fe0-06b0-46ac-81b1-5f5d3933f66e service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:36.016097 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-98d4ba73-6b58-4b55-907b-c8c66df87577 req-d5cb5fe0-06b0-46ac-81b1-5f5d3933f66e service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:36.016560 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-98d4ba73-6b58-4b55-907b-c8c66df87577 req-d5cb5fe0-06b0-46ac-81b1-5f5d3933f66e service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:36.029812 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-98d4ba73-6b58-4b55-907b-c8c66df87577 req-d5cb5fe0-06b0-46ac-81b1-5f5d3933f66e service nova] Creating event network-vif-plugged:60723675-08fc-443b-9199-a4d4fdaeb719 for instance af98ca5b-174f-43f9-a582-af6ad3342b87 on hv-cinder-79966 Sep 03 03:52:36.035142 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-98d4ba73-6b58-4b55-907b-c8c66df87577 req-d5cb5fe0-06b0-46ac-81b1-5f5d3933f66e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033561 Sep 03 03:52:36.036075 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 262/522] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:52:36.357180 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-69125459-8a95-4699-82f6-bea09fa72a97 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:36.357886 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-69125459-8a95-4699-82f6-bea09fa72a97 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:36.364702 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-69125459-8a95-4699-82f6-bea09fa72a97 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:36.365189 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-69125459-8a95-4699-82f6-bea09fa72a97 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:36.365620 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-69125459-8a95-4699-82f6-bea09fa72a97 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:36.366326 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-69125459-8a95-4699-82f6-bea09fa72a97 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:36.366780 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-69125459-8a95-4699-82f6-bea09fa72a97 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:36.367378 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-69125459-8a95-4699-82f6-bea09fa72a97 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:36.510350 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-69125459-8a95-4699-82f6-bea09fa72a97 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:36.521526 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-69125459-8a95-4699-82f6-bea09fa72a97 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1258 microversion: 2.1 time: 0.168760 Sep 03 03:52:36.522114 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 261/523] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:36 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1258 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:36.869008 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-6f4416ec-6837-49a1-8ff5-08e772b7f958 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:36.869556 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-6f4416ec-6837-49a1-8ff5-08e772b7f958 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 4debbf95-0ffb-408e-bc62-12015a742cff] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:36.878397 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6f4416ec-6837-49a1-8ff5-08e772b7f958 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:36.881135 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6f4416ec-6837-49a1-8ff5-08e772b7f958 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:36.881590 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6f4416ec-6837-49a1-8ff5-08e772b7f958 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:36.882561 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6f4416ec-6837-49a1-8ff5-08e772b7f958 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:36.883138 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6f4416ec-6837-49a1-8ff5-08e772b7f958 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:36.883611 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6f4416ec-6837-49a1-8ff5-08e772b7f958 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:37.025307 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-6f4416ec-6837-49a1-8ff5-08e772b7f958 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0647075204ba183fb1e5beb2c5930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bafae6685e248d2ac4fab672648e941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:37.033481 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-6f4416ec-6837-49a1-8ff5-08e772b7f958 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "GET /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff" status: 200 len: 1319 microversion: 2.1 time: 0.169438 Sep 03 03:52:37.034056 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 263/524] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:36 2022] GET /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:37.549883 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-04df81d9-577b-4f8a-87f0-48a67c0d9093 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:37.550604 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-04df81d9-577b-4f8a-87f0-48a67c0d9093 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:37.559598 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-04df81d9-577b-4f8a-87f0-48a67c0d9093 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:37.560112 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-04df81d9-577b-4f8a-87f0-48a67c0d9093 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:37.560634 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-04df81d9-577b-4f8a-87f0-48a67c0d9093 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:37.561467 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-04df81d9-577b-4f8a-87f0-48a67c0d9093 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:37.561789 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-04df81d9-577b-4f8a-87f0-48a67c0d9093 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:37.562358 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-04df81d9-577b-4f8a-87f0-48a67c0d9093 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:37.698047 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-04df81d9-577b-4f8a-87f0-48a67c0d9093 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:37.706528 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-04df81d9-577b-4f8a-87f0-48a67c0d9093 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1258 microversion: 2.1 time: 0.162024 Sep 03 03:52:37.707118 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 262/525] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:37 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:38.056853 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-0c819d54-116d-4a92-92f0-27da2c34427f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:38.057427 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-0c819d54-116d-4a92-92f0-27da2c34427f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 4debbf95-0ffb-408e-bc62-12015a742cff] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:38.064425 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0c819d54-116d-4a92-92f0-27da2c34427f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:38.064900 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0c819d54-116d-4a92-92f0-27da2c34427f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:38.065347 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0c819d54-116d-4a92-92f0-27da2c34427f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:38.066018 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0c819d54-116d-4a92-92f0-27da2c34427f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:38.066461 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0c819d54-116d-4a92-92f0-27da2c34427f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:38.066905 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0c819d54-116d-4a92-92f0-27da2c34427f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:38.199141 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-0c819d54-116d-4a92-92f0-27da2c34427f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0647075204ba183fb1e5beb2c5930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bafae6685e248d2ac4fab672648e941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:38.206836 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-0c819d54-116d-4a92-92f0-27da2c34427f tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "GET /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff" status: 200 len: 1319 microversion: 2.1 time: 0.154015 Sep 03 03:52:38.207364 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 264/526] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:38 2022] GET /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:38.730603 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-01ffadc8-d9db-4792-a10d-3a2482c4000b tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:38.731225 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-01ffadc8-d9db-4792-a10d-3a2482c4000b tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:38.737912 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-01ffadc8-d9db-4792-a10d-3a2482c4000b tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:38.738357 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-01ffadc8-d9db-4792-a10d-3a2482c4000b tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:38.738782 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-01ffadc8-d9db-4792-a10d-3a2482c4000b tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:38.739487 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-01ffadc8-d9db-4792-a10d-3a2482c4000b tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:38.739936 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-01ffadc8-d9db-4792-a10d-3a2482c4000b tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:38.740365 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-01ffadc8-d9db-4792-a10d-3a2482c4000b tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:38.873402 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-01ffadc8-d9db-4792-a10d-3a2482c4000b tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:38.881289 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-01ffadc8-d9db-4792-a10d-3a2482c4000b tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1258 microversion: 2.1 time: 0.154882 Sep 03 03:52:38.881826 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 263/527] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:38 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:39.229805 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-cad58380-bfaf-4b53-86fc-742a9bb8104b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:39.230377 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-cad58380-bfaf-4b53-86fc-742a9bb8104b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 4debbf95-0ffb-408e-bc62-12015a742cff] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:39.237509 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cad58380-bfaf-4b53-86fc-742a9bb8104b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:39.237963 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cad58380-bfaf-4b53-86fc-742a9bb8104b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:39.238631 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cad58380-bfaf-4b53-86fc-742a9bb8104b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:39.239384 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cad58380-bfaf-4b53-86fc-742a9bb8104b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:39.239830 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cad58380-bfaf-4b53-86fc-742a9bb8104b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:39.240248 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cad58380-bfaf-4b53-86fc-742a9bb8104b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:39.445809 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-cad58380-bfaf-4b53-86fc-742a9bb8104b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0647075204ba183fb1e5beb2c5930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bafae6685e248d2ac4fab672648e941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:39.454020 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-cad58380-bfaf-4b53-86fc-742a9bb8104b tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "GET /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff" status: 200 len: 1319 microversion: 2.1 time: 0.228256 Sep 03 03:52:39.454602 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 265/528] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:39 2022] GET /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:39.906284 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-455ea21b-89f3-4851-99b6-6c9223be7c74 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:39.907557 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-455ea21b-89f3-4851-99b6-6c9223be7c74 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:39.914909 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-455ea21b-89f3-4851-99b6-6c9223be7c74 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:39.915615 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-455ea21b-89f3-4851-99b6-6c9223be7c74 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:39.916068 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-455ea21b-89f3-4851-99b6-6c9223be7c74 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:39.916802 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-455ea21b-89f3-4851-99b6-6c9223be7c74 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:39.919218 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-455ea21b-89f3-4851-99b6-6c9223be7c74 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:39.919701 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-455ea21b-89f3-4851-99b6-6c9223be7c74 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:39.924388 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:52:40.059228 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-455ea21b-89f3-4851-99b6-6c9223be7c74 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:40.067878 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-455ea21b-89f3-4851-99b6-6c9223be7c74 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1443 microversion: 2.1 time: 0.165599 Sep 03 03:52:40.068797 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 264/529] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:39 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1443 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:40.085266 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-b0e9f17d-29db-459d-bd43-f4a42d639a25 req-de5ee3a9-289e-4874-9597-e826f86fa086 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4debbf95-0ffb-408e-bc62-12015a742cff", "name": "network-vif-plugged", "status": "completed", "tag": "c369599b-8063-4d16-b7ee-03c9e0bbb2e5"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:52:40.090994 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-8c59f375-b1fe-4029-b5a5-c16a391a8567 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:40.091973 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-8c59f375-b1fe-4029-b5a5-c16a391a8567 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:40.096328 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-b0e9f17d-29db-459d-bd43-f4a42d639a25 req-de5ee3a9-289e-4874-9597-e826f86fa086 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:40.096804 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-b0e9f17d-29db-459d-bd43-f4a42d639a25 req-de5ee3a9-289e-4874-9597-e826f86fa086 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:40.097217 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-b0e9f17d-29db-459d-bd43-f4a42d639a25 req-de5ee3a9-289e-4874-9597-e826f86fa086 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:40.098613 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8c59f375-b1fe-4029-b5a5-c16a391a8567 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:40.099209 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8c59f375-b1fe-4029-b5a5-c16a391a8567 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:40.099706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8c59f375-b1fe-4029-b5a5-c16a391a8567 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:40.100628 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8c59f375-b1fe-4029-b5a5-c16a391a8567 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:40.101598 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8c59f375-b1fe-4029-b5a5-c16a391a8567 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:40.101918 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8c59f375-b1fe-4029-b5a5-c16a391a8567 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:40.109390 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-b0e9f17d-29db-459d-bd43-f4a42d639a25 req-de5ee3a9-289e-4874-9597-e826f86fa086 service nova] Creating event network-vif-plugged:c369599b-8063-4d16-b7ee-03c9e0bbb2e5 for instance 4debbf95-0ffb-408e-bc62-12015a742cff on hv-cinder-79966 Sep 03 03:52:40.114682 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-b0e9f17d-29db-459d-bd43-f4a42d639a25 req-de5ee3a9-289e-4874-9597-e826f86fa086 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034923 Sep 03 03:52:40.115522 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 266/530] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:52:40.243089 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-8c59f375-b1fe-4029-b5a5-c16a391a8567 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:40.251321 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-8c59f375-b1fe-4029-b5a5-c16a391a8567 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1443 microversion: 2.1 time: 0.164667 Sep 03 03:52:40.252210 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 265/531] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:40 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1443 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:40.477804 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-6b3aee58-eeb9-47b5-8bc8-987f37bb58ac tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:40.478500 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-6b3aee58-eeb9-47b5-8bc8-987f37bb58ac tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 4debbf95-0ffb-408e-bc62-12015a742cff] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:40.485995 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6b3aee58-eeb9-47b5-8bc8-987f37bb58ac tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:40.486412 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6b3aee58-eeb9-47b5-8bc8-987f37bb58ac tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:40.486869 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6b3aee58-eeb9-47b5-8bc8-987f37bb58ac tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:40.487565 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6b3aee58-eeb9-47b5-8bc8-987f37bb58ac tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:40.488015 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6b3aee58-eeb9-47b5-8bc8-987f37bb58ac tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:40.488432 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6b3aee58-eeb9-47b5-8bc8-987f37bb58ac tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:40.692563 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-6b3aee58-eeb9-47b5-8bc8-987f37bb58ac tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0647075204ba183fb1e5beb2c5930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bafae6685e248d2ac4fab672648e941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:40.702935 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-6b3aee58-eeb9-47b5-8bc8-987f37bb58ac tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "GET /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff" status: 200 len: 1319 microversion: 2.1 time: 0.229130 Sep 03 03:52:40.703970 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 267/532] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:40 2022] GET /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:41.729244 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-46073068-73dd-4ca5-ac77-79f994c55213 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:41.734283 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-46073068-73dd-4ca5-ac77-79f994c55213 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 4debbf95-0ffb-408e-bc62-12015a742cff] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:41.742938 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-46073068-73dd-4ca5-ac77-79f994c55213 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:41.743461 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-46073068-73dd-4ca5-ac77-79f994c55213 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:41.743891 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-46073068-73dd-4ca5-ac77-79f994c55213 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:41.744591 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-46073068-73dd-4ca5-ac77-79f994c55213 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:41.745040 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-46073068-73dd-4ca5-ac77-79f994c55213 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:41.745601 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-46073068-73dd-4ca5-ac77-79f994c55213 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:41.876670 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-46073068-73dd-4ca5-ac77-79f994c55213 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0647075204ba183fb1e5beb2c5930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bafae6685e248d2ac4fab672648e941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:41.884809 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-46073068-73dd-4ca5-ac77-79f994c55213 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "GET /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff" status: 200 len: 1319 microversion: 2.1 time: 0.159441 Sep 03 03:52:41.885356 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 266/533] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:41 2022] GET /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:41.953404 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-ae76b34f-b438-4ddf-af9e-8a46b1b42561 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:52:41.955718 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-ae76b34f-b438-4ddf-af9e-8a46b1b42561 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:41.959907 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell0:SELECT=2 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:52:41.963740 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ae76b34f-b438-4ddf-af9e-8a46b1b42561 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:41.964361 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ae76b34f-b438-4ddf-af9e-8a46b1b42561 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:41.964806 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ae76b34f-b438-4ddf-af9e-8a46b1b42561 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:41.965509 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ae76b34f-b438-4ddf-af9e-8a46b1b42561 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:41.965954 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ae76b34f-b438-4ddf-af9e-8a46b1b42561 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:41.966377 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ae76b34f-b438-4ddf-af9e-8a46b1b42561 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:41.981018 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell0:SELECT=6 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:52:41.991682 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.objects.instance [None req-ae76b34f-b438-4ddf-af9e-8a46b1b42561 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lazy-loading 'flavor' on Instance uuid 4f5b827b-0905-4360-b0b5-f5881a029bc2 {{(pid=132076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 03:52:42.097041 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-e47344cf-3950-41a5-93d5-d6bb407e9378 req-d6e8c59a-dc8f-47c3-a174-9d2ae424e641 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af98ca5b-174f-43f9-a582-af6ad3342b87", "tag": "60723675-08fc-443b-9199-a4d4fdaeb719"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:52:42.108562 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-e47344cf-3950-41a5-93d5-d6bb407e9378 req-d6e8c59a-dc8f-47c3-a174-9d2ae424e641 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:42.109041 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-e47344cf-3950-41a5-93d5-d6bb407e9378 req-d6e8c59a-dc8f-47c3-a174-9d2ae424e641 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:42.109464 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-e47344cf-3950-41a5-93d5-d6bb407e9378 req-d6e8c59a-dc8f-47c3-a174-9d2ae424e641 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:42.113747 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell0:SELECT=2 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:52:42.122833 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-e47344cf-3950-41a5-93d5-d6bb407e9378 req-d6e8c59a-dc8f-47c3-a174-9d2ae424e641 service nova] Creating event network-changed:60723675-08fc-443b-9199-a4d4fdaeb719 for instance af98ca5b-174f-43f9-a582-af6ad3342b87 on hv-cinder-79966 Sep 03 03:52:42.125404 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-ae76b34f-b438-4ddf-af9e-8a46b1b42561 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "POST /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2/action" status: 200 len: 32 microversion: 2.1 time: 0.176061 Sep 03 03:52:42.126629 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 268/534] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Sep 3 03:52:41 2022] POST /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2/action => generated 32 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 03 03:52:42.127687 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-e47344cf-3950-41a5-93d5-d6bb407e9378 req-d6e8c59a-dc8f-47c3-a174-9d2ae424e641 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034361 Sep 03 03:52:42.128703 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 267/535] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 03:52:42.137530 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-35345b88-1dbd-4664-adc4-5c0a4edf2f81 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:42.138223 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-35345b88-1dbd-4664-adc4-5c0a4edf2f81 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:42.144658 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-35345b88-1dbd-4664-adc4-5c0a4edf2f81 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:42.145135 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-35345b88-1dbd-4664-adc4-5c0a4edf2f81 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:42.145563 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-35345b88-1dbd-4664-adc4-5c0a4edf2f81 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:42.146254 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-35345b88-1dbd-4664-adc4-5c0a4edf2f81 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:42.146708 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-35345b88-1dbd-4664-adc4-5c0a4edf2f81 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:42.147153 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-35345b88-1dbd-4664-adc4-5c0a4edf2f81 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:42.151238 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:52:42.292311 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-35345b88-1dbd-4664-adc4-5c0a4edf2f81 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:42.300721 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-35345b88-1dbd-4664-adc4-5c0a4edf2f81 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1736 microversion: 2.1 time: 0.167691 Sep 03 03:52:42.301284 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 269/536] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:42 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:42.912673 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-83aaa209-5dc6-4576-a3e4-bf2f8775e57d tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:42.912673 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-83aaa209-5dc6-4576-a3e4-bf2f8775e57d tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 4debbf95-0ffb-408e-bc62-12015a742cff] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:42.920670 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-83aaa209-5dc6-4576-a3e4-bf2f8775e57d tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:42.921232 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-83aaa209-5dc6-4576-a3e4-bf2f8775e57d tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:42.921653 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-83aaa209-5dc6-4576-a3e4-bf2f8775e57d tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:42.924419 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-83aaa209-5dc6-4576-a3e4-bf2f8775e57d tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:42.924908 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-83aaa209-5dc6-4576-a3e4-bf2f8775e57d tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:42.925382 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-83aaa209-5dc6-4576-a3e4-bf2f8775e57d tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:43.068123 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-83aaa209-5dc6-4576-a3e4-bf2f8775e57d tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0647075204ba183fb1e5beb2c5930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bafae6685e248d2ac4fab672648e941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:43.076062 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-83aaa209-5dc6-4576-a3e4-bf2f8775e57d tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "GET /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff" status: 200 len: 1319 microversion: 2.1 time: 0.172504 Sep 03 03:52:43.076607 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 268/537] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:42 2022] GET /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:43.326339 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-cb92f17d-6edd-4f75-becb-d317105f6261 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:43.326938 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-cb92f17d-6edd-4f75-becb-d317105f6261 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:43.333818 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cb92f17d-6edd-4f75-becb-d317105f6261 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:43.334305 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cb92f17d-6edd-4f75-becb-d317105f6261 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:43.334736 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cb92f17d-6edd-4f75-becb-d317105f6261 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:43.335461 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cb92f17d-6edd-4f75-becb-d317105f6261 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:43.335882 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cb92f17d-6edd-4f75-becb-d317105f6261 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:43.336337 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cb92f17d-6edd-4f75-becb-d317105f6261 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:43.466979 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-cb92f17d-6edd-4f75-becb-d317105f6261 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:43.475268 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-cb92f17d-6edd-4f75-becb-d317105f6261 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1736 microversion: 2.1 time: 0.153779 Sep 03 03:52:43.475832 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 270/538] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:43 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:44.099302 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-f35b3341-d3c6-464a-84cc-da08c63ed608 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:44.099903 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-f35b3341-d3c6-464a-84cc-da08c63ed608 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 4debbf95-0ffb-408e-bc62-12015a742cff] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:44.106623 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f35b3341-d3c6-464a-84cc-da08c63ed608 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:44.108230 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f35b3341-d3c6-464a-84cc-da08c63ed608 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:44.108728 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f35b3341-d3c6-464a-84cc-da08c63ed608 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:44.109543 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f35b3341-d3c6-464a-84cc-da08c63ed608 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:44.109964 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f35b3341-d3c6-464a-84cc-da08c63ed608 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:44.110547 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f35b3341-d3c6-464a-84cc-da08c63ed608 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:44.253829 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-f35b3341-d3c6-464a-84cc-da08c63ed608 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0647075204ba183fb1e5beb2c5930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bafae6685e248d2ac4fab672648e941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:44.262646 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-f35b3341-d3c6-464a-84cc-da08c63ed608 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "GET /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff" status: 200 len: 1507 microversion: 2.1 time: 0.167177 Sep 03 03:52:44.263344 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 269/539] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:44 2022] GET /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:44.289644 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-968d9ae4-2a65-436c-99e5-bbfa99cc32f9 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d7784fa-4460-47a6-82a9-40d3289be49c", "device": "/dev/sdb"}} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:52:44.292239 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-968d9ae4-2a65-436c-99e5-bbfa99cc32f9 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 4debbf95-0ffb-408e-bc62-12015a742cff] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:44.298407 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-968d9ae4-2a65-436c-99e5-bbfa99cc32f9 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:44.298910 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-968d9ae4-2a65-436c-99e5-bbfa99cc32f9 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:44.299342 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-968d9ae4-2a65-436c-99e5-bbfa99cc32f9 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:44.300021 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-968d9ae4-2a65-436c-99e5-bbfa99cc32f9 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:44.300464 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-968d9ae4-2a65-436c-99e5-bbfa99cc32f9 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:44.300880 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-968d9ae4-2a65-436c-99e5-bbfa99cc32f9 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:44.499690 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-d2769065-1578-4695-9f70-9989792966a2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:44.500315 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-d2769065-1578-4695-9f70-9989792966a2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:44.506767 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d2769065-1578-4695-9f70-9989792966a2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:44.507319 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d2769065-1578-4695-9f70-9989792966a2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:44.507751 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d2769065-1578-4695-9f70-9989792966a2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:44.508521 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d2769065-1578-4695-9f70-9989792966a2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:44.508977 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d2769065-1578-4695-9f70-9989792966a2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:44.509508 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d2769065-1578-4695-9f70-9989792966a2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:44.619622 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-968d9ae4-2a65-436c-99e5-bbfa99cc32f9 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "POST /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.333776 Sep 03 03:52:44.621291 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 271/540] 10.222.0.25 () {60 vars in 1323 bytes} [Sat Sep 3 03:52:44 2022] POST /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff/os-volume_attachments => generated 194 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:52:44.661371 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-d2769065-1578-4695-9f70-9989792966a2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:44.670435 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-d2769065-1578-4695-9f70-9989792966a2 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1736 microversion: 2.1 time: 0.174957 Sep 03 03:52:44.671007 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 270/541] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:44 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:45.697007 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-28e98855-8f88-44fe-a7a9-eb1ef0770984 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:45.698448 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-28e98855-8f88-44fe-a7a9-eb1ef0770984 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:45.705271 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-28e98855-8f88-44fe-a7a9-eb1ef0770984 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:45.706057 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-28e98855-8f88-44fe-a7a9-eb1ef0770984 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:45.706558 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-28e98855-8f88-44fe-a7a9-eb1ef0770984 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:45.707340 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-28e98855-8f88-44fe-a7a9-eb1ef0770984 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:45.707848 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-28e98855-8f88-44fe-a7a9-eb1ef0770984 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:45.708336 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-28e98855-8f88-44fe-a7a9-eb1ef0770984 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:45.846581 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-28e98855-8f88-44fe-a7a9-eb1ef0770984 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:45.860028 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-28e98855-8f88-44fe-a7a9-eb1ef0770984 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1736 microversion: 2.1 time: 0.168260 Sep 03 03:52:45.860783 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 272/542] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:45 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:46.891086 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-d4d9b8d4-8722-4c9e-8694-17e1a1c71a05 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:46.892063 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-d4d9b8d4-8722-4c9e-8694-17e1a1c71a05 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:46.903388 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d4d9b8d4-8722-4c9e-8694-17e1a1c71a05 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:46.904180 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d4d9b8d4-8722-4c9e-8694-17e1a1c71a05 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:46.904890 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d4d9b8d4-8722-4c9e-8694-17e1a1c71a05 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:46.906026 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d4d9b8d4-8722-4c9e-8694-17e1a1c71a05 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:46.906772 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d4d9b8d4-8722-4c9e-8694-17e1a1c71a05 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:46.907513 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d4d9b8d4-8722-4c9e-8694-17e1a1c71a05 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:47.064387 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-d4d9b8d4-8722-4c9e-8694-17e1a1c71a05 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:47.073219 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-d4d9b8d4-8722-4c9e-8694-17e1a1c71a05 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1736 microversion: 2.1 time: 0.188653 Sep 03 03:52:47.073827 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 271/543] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:46 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1736 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:48.100890 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-21cfc122-4dcf-41cc-898d-be79be07ac64 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:48.101791 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-21cfc122-4dcf-41cc-898d-be79be07ac64 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:48.105613 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:52:48.115114 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-21cfc122-4dcf-41cc-898d-be79be07ac64 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:48.115906 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-21cfc122-4dcf-41cc-898d-be79be07ac64 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:48.116605 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-21cfc122-4dcf-41cc-898d-be79be07ac64 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:48.117731 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-21cfc122-4dcf-41cc-898d-be79be07ac64 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:48.118516 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-21cfc122-4dcf-41cc-898d-be79be07ac64 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:48.119243 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-21cfc122-4dcf-41cc-898d-be79be07ac64 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:48.163430 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-9a51ece8-fecd-4eac-956d-1b50c32c12df tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:48.164040 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-9a51ece8-fecd-4eac-956d-1b50c32c12df tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:48.170584 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9a51ece8-fecd-4eac-956d-1b50c32c12df tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:48.171105 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9a51ece8-fecd-4eac-956d-1b50c32c12df tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:48.171531 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9a51ece8-fecd-4eac-956d-1b50c32c12df tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:48.172227 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9a51ece8-fecd-4eac-956d-1b50c32c12df tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:48.172675 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9a51ece8-fecd-4eac-956d-1b50c32c12df tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:48.173089 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9a51ece8-fecd-4eac-956d-1b50c32c12df tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:48.256856 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-21cfc122-4dcf-41cc-898d-be79be07ac64 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:48.260543 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.objects.instance [None req-9a51ece8-fecd-4eac-956d-1b50c32c12df tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lazy-loading 'services' on Instance uuid 828bd786-6e99-4ccd-a4aa-9198ef8c8731 {{(pid=132077) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 03:52:48.265513 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-21cfc122-4dcf-41cc-898d-be79be07ac64 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1736 microversion: 2.1 time: 0.171251 Sep 03 03:52:48.266081 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 273/544] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:48 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:48.336063 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-9a51ece8-fecd-4eac-956d-1b50c32c12df tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "DELETE /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731/os-volume_attachments/0daeb897-d847-440d-b3bf-823ac3484d96" status: 202 len: 0 microversion: 2.1 time: 0.176584 Sep 03 03:52:48.336782 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 272/545] 10.222.0.25 () {58 vars in 1416 bytes} [Sat Sep 3 03:52:48 2022] DELETE /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731/os-volume_attachments/0daeb897-d847-440d-b3bf-823ac3484d96 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 03:52:48.647371 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-09438bf7-167b-477a-8711-60467e04681b tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:48.647828 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-09438bf7-167b-477a-8711-60467e04681b tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: f23f06ef-2db1-4e7b-a2f4-71927f83b40d] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:48.656004 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-09438bf7-167b-477a-8711-60467e04681b tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:48.656472 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-09438bf7-167b-477a-8711-60467e04681b tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:48.656898 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-09438bf7-167b-477a-8711-60467e04681b tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:48.657560 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-09438bf7-167b-477a-8711-60467e04681b tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:48.658025 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-09438bf7-167b-477a-8711-60467e04681b tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:48.658440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-09438bf7-167b-477a-8711-60467e04681b tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:48.681366 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-09438bf7-167b-477a-8711-60467e04681b tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d/ips" status: 200 len: 150 microversion: 2.1 time: 0.040391 Sep 03 03:52:48.681910 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 274/546] 10.222.0.25 () {58 vars in 1248 bytes} [Sat Sep 3 03:52:48 2022] GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:52:48.694678 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-23977280-18fa-40b1-a5fe-b07fad214f33 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b44551c4-c873-436b-92b6-0e253b28976e"}} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:52:48.697300 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-23977280-18fa-40b1-a5fe-b07fad214f33 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: f23f06ef-2db1-4e7b-a2f4-71927f83b40d] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:48.703717 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-23977280-18fa-40b1-a5fe-b07fad214f33 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:48.704191 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-23977280-18fa-40b1-a5fe-b07fad214f33 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:48.704614 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-23977280-18fa-40b1-a5fe-b07fad214f33 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:48.705356 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-23977280-18fa-40b1-a5fe-b07fad214f33 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:48.705792 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-23977280-18fa-40b1-a5fe-b07fad214f33 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:48.706206 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-23977280-18fa-40b1-a5fe-b07fad214f33 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:48.787624 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.wsgi [None req-23977280-18fa-40b1-a5fe-b07fad214f33 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] HTTP exception thrown: Invalid volume: volume b44551c4-c873-436b-92b6-0e253b28976e is already attached to instances: 69fe618d-1192-4541-9d90-e5cee06be911 Sep 03 03:52:48.789370 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-23977280-18fa-40b1-a5fe-b07fad214f33 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Request method failure captured: Sep 03 03:52:48.789370 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: request: POST /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d/os-volume_attachments HTTP/1.1 Sep 03 03:52:48.789370 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept: application/json Sep 03 03:52:48.789370 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept-Encoding: identity Sep 03 03:52:48.789370 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Connection: close Sep 03 03:52:48.789370 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Length: 74 Sep 03 03:52:48.789370 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Type: application/json Sep 03 03:52:48.789370 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Host: 10.222.0.25 Sep 03 03:52:48.789370 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Openstack-System-Scope: None Sep 03 03:52:48.789370 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: User-Agent: python-urllib3/1.26.12 Sep 03 03:52:48.789370 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Auth-Token: gAAAAABjEs650LfhdeTARTcps2T6trtQQt2m5icunzzvIWer-eUYgJYZG5Pjv6m6uWkZdMglMW7-SwnvvwA9dyIFe0GhqjthXj4rFLg5_wGV22DwN7Tu1nE8T--OP86NZDND7AUMPsZwRHed6vQjd_qeShmm1sU59yMmrfP4r0ItLtiNkEQOrd0 Sep 03 03:52:48.789370 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Id: None Sep 03 03:52:48.789370 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Name: None Sep 03 03:52:48.789370 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Identity-Status: Confirmed Sep 03 03:52:48.789370 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Is-Admin-Project: True Sep 03 03:52:48.789370 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Id: default Sep 03 03:52:48.789370 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Name: Default Sep 03 03:52:48.789370 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Id: ac9e77355ba040bda4f2186753df7b24 Sep 03 03:52:48.789370 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Name: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:52:48.789370 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Role: member,reader Sep 03 03:52:48.789370 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Roles: member,reader Sep 03 03:52:48.790922 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:52:48.790922 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:52:48.790922 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Id: ac9e77355ba040bda4f2186753df7b24 Sep 03 03:52:48.790922 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:52:48.790922 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User: tempest-AttachVolumeNegativeTest-1116033749-project Sep 03 03:52:48.790922 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Id: default Sep 03 03:52:48.790922 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Name: Default Sep 03 03:52:48.790922 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Id: 1dde7fad075145c89f726ca85c6c00ba Sep 03 03:52:48.790922 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Name: tempest-AttachVolumeNegativeTest-1116033749-project Sep 03 03:52:48.790922 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Sep 03 03:52:48.790922 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: {"volumeAttachment": {"volumeId": "b44551c4-c873-436b-92b6-0e253b28976e"}} Sep 03 03:52:48.790922 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: method: > Sep 03 03:52:48.791836 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: exception: Invalid volume: volume b44551c4-c873-436b-92b6-0e253b28976e is already attached to instances: 69fe618d-1192-4541-9d90-e5cee06be911 Sep 03 03:52:48.791836 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: action_args: {'server_id': 'f23f06ef-2db1-4e7b-a2f4-71927f83b40d', 'body': {'volumeAttachment': {'volumeId': 'b44551c4-c873-436b-92b6-0e253b28976e'}}} Sep 03 03:52:48.791836 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:52:48.791836 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:52:48.791836 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 03 03:52:48.791836 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 03 03:52:48.791836 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 03 03:52:48.791836 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 03 03:52:48.791836 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 03 03:52:48.791836 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 03 03:52:48.791836 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 03 03:52:48.791836 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 03 03:52:48.791836 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 03 03:52:48.791836 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 03 03:52:48.791836 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b44551c4-c873-436b-92b6-0e253b28976e is already attached to instances: 69fe618d-1192-4541-9d90-e5cee06be911 Sep 03 03:52:48.791836 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:52:48.791836 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:52:48.791836 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:52:48.791836 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:52:48.793211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:52:48.793211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:52:48.793211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:52:48.793211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:52:48.793211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:52:48.793211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:52:48.793211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 03:52:48.793211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 03:52:48.793211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 03:52:48.793211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 03:52:48.793211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 03:52:48.793211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 03:52:48.793211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 03 03:52:48.793211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 03 03:52:48.793211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b44551c4-c873-436b-92b6-0e253b28976e is already attached to instances: 69fe618d-1192-4541-9d90-e5cee06be911 Sep 03 03:52:48.793211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:52:48.793211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:52:48.793211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:52:48.793211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:52:48.793211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:52:48.795071 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:52:48.795071 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:52:48.795071 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:52:48.795071 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b44551c4-c873-436b-92b6-0e253b28976e is already attached to instances: 69fe618d-1192-4541-9d90-e5cee06be911 Sep 03 03:52:48.795071 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:52:48.795071 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-23977280-18fa-40b1-a5fe-b07fad214f33 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Returning 400 to user: Invalid volume: volume b44551c4-c873-436b-92b6-0e253b28976e is already attached to instances: 69fe618d-1192-4541-9d90-e5cee06be911 {{(pid=132077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:52:48.795071 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-23977280-18fa-40b1-a5fe-b07fad214f33 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "POST /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100524 Sep 03 03:52:48.795071 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 273/547] 10.222.0.25 () {60 vars in 1323 bytes} [Sat Sep 3 03:52:48 2022] POST /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 03:52:48.799869 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-32c5ab2d-e073-4f19-a298-ff9a29e89734 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:48.800358 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-32c5ab2d-e073-4f19-a298-ff9a29e89734 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: f23f06ef-2db1-4e7b-a2f4-71927f83b40d] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:48.806947 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-32c5ab2d-e073-4f19-a298-ff9a29e89734 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:48.807427 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-32c5ab2d-e073-4f19-a298-ff9a29e89734 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:48.807852 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-32c5ab2d-e073-4f19-a298-ff9a29e89734 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:48.808537 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-32c5ab2d-e073-4f19-a298-ff9a29e89734 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:48.809101 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-32c5ab2d-e073-4f19-a298-ff9a29e89734 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:48.809523 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-32c5ab2d-e073-4f19-a298-ff9a29e89734 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:48.834509 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-32c5ab2d-e073-4f19-a298-ff9a29e89734 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: f23f06ef-2db1-4e7b-a2f4-71927f83b40d] Going to try to terminate instance {{(pid=132076) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 03:52:48.925242 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-32c5ab2d-e073-4f19-a298-ff9a29e89734 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d" status: 204 len: 0 microversion: 2.1 time: 0.128933 Sep 03 03:52:48.928945 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 275/548] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Sep 3 03:52:48 2022] DELETE /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 03:52:48.936439 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-9df9cdeb-5799-4064-9fe1-98a493d3a673 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:48.937082 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-9df9cdeb-5799-4064-9fe1-98a493d3a673 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: f23f06ef-2db1-4e7b-a2f4-71927f83b40d] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:48.947275 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9df9cdeb-5799-4064-9fe1-98a493d3a673 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:48.947761 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9df9cdeb-5799-4064-9fe1-98a493d3a673 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:48.948186 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9df9cdeb-5799-4064-9fe1-98a493d3a673 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:48.948881 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9df9cdeb-5799-4064-9fe1-98a493d3a673 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:48.949481 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9df9cdeb-5799-4064-9fe1-98a493d3a673 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:48.950250 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9df9cdeb-5799-4064-9fe1-98a493d3a673 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:49.083911 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-9df9cdeb-5799-4064-9fe1-98a493d3a673 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:49.091774 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-9df9cdeb-5799-4064-9fe1-98a493d3a673 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d" status: 200 len: 1681 microversion: 2.1 time: 0.161102 Sep 03 03:52:49.092330 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 274/549] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:48 2022] GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:49.289503 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-ee7ec089-164c-4c95-b0ae-dd3b378f72af tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:49.290202 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-ee7ec089-164c-4c95-b0ae-dd3b378f72af tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:49.296872 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ee7ec089-164c-4c95-b0ae-dd3b378f72af tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:49.297361 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ee7ec089-164c-4c95-b0ae-dd3b378f72af tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:49.297796 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ee7ec089-164c-4c95-b0ae-dd3b378f72af tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:49.298496 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ee7ec089-164c-4c95-b0ae-dd3b378f72af tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:49.298987 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ee7ec089-164c-4c95-b0ae-dd3b378f72af tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:49.299411 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ee7ec089-164c-4c95-b0ae-dd3b378f72af tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:49.448327 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-ee7ec089-164c-4c95-b0ae-dd3b378f72af tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:49.457181 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-ee7ec089-164c-4c95-b0ae-dd3b378f72af tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1736 microversion: 2.1 time: 0.171940 Sep 03 03:52:49.457753 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 276/550] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:49 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:50.121410 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-c6643f57-02aa-4c66-b04c-f280e4e04bb7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:50.122462 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-c6643f57-02aa-4c66-b04c-f280e4e04bb7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: f23f06ef-2db1-4e7b-a2f4-71927f83b40d] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:50.129236 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c6643f57-02aa-4c66-b04c-f280e4e04bb7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:50.129634 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c6643f57-02aa-4c66-b04c-f280e4e04bb7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:50.130073 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c6643f57-02aa-4c66-b04c-f280e4e04bb7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:50.130755 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c6643f57-02aa-4c66-b04c-f280e4e04bb7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:50.131244 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c6643f57-02aa-4c66-b04c-f280e4e04bb7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:50.131659 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c6643f57-02aa-4c66-b04c-f280e4e04bb7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:50.270240 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-c6643f57-02aa-4c66-b04c-f280e4e04bb7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:50.277898 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-c6643f57-02aa-4c66-b04c-f280e4e04bb7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d" status: 200 len: 1681 microversion: 2.1 time: 0.163939 Sep 03 03:52:50.278567 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 275/551] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:50 2022] GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:50.483971 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-5770daa7-0403-4780-bed7-c862e024a107 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:50.484580 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-5770daa7-0403-4780-bed7-c862e024a107 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:50.491077 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5770daa7-0403-4780-bed7-c862e024a107 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:50.491563 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5770daa7-0403-4780-bed7-c862e024a107 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:50.491995 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5770daa7-0403-4780-bed7-c862e024a107 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:50.492690 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5770daa7-0403-4780-bed7-c862e024a107 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:50.493140 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5770daa7-0403-4780-bed7-c862e024a107 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:50.493566 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5770daa7-0403-4780-bed7-c862e024a107 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:50.628780 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-5770daa7-0403-4780-bed7-c862e024a107 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:50.637288 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-5770daa7-0403-4780-bed7-c862e024a107 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1736 microversion: 2.1 time: 0.158804 Sep 03 03:52:50.637989 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 277/552] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:50 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:51.300944 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-5942c31b-c37d-43d8-8f2c-7be58be35621 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:51.301552 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-5942c31b-c37d-43d8-8f2c-7be58be35621 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: f23f06ef-2db1-4e7b-a2f4-71927f83b40d] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:51.308074 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5942c31b-c37d-43d8-8f2c-7be58be35621 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:51.308533 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5942c31b-c37d-43d8-8f2c-7be58be35621 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:51.308975 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5942c31b-c37d-43d8-8f2c-7be58be35621 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:51.309717 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5942c31b-c37d-43d8-8f2c-7be58be35621 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:51.310161 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5942c31b-c37d-43d8-8f2c-7be58be35621 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:51.310593 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5942c31b-c37d-43d8-8f2c-7be58be35621 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:51.439195 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-5942c31b-c37d-43d8-8f2c-7be58be35621 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:51.447068 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-5942c31b-c37d-43d8-8f2c-7be58be35621 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d" status: 200 len: 1681 microversion: 2.1 time: 0.150020 Sep 03 03:52:51.447637 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 276/553] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:51 2022] GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:51.672417 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-d6346124-98bc-45dc-8017-e1eb38400401 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:51.674260 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-d6346124-98bc-45dc-8017-e1eb38400401 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:51.683895 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d6346124-98bc-45dc-8017-e1eb38400401 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:51.684724 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d6346124-98bc-45dc-8017-e1eb38400401 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:51.685161 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d6346124-98bc-45dc-8017-e1eb38400401 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:51.685866 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d6346124-98bc-45dc-8017-e1eb38400401 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:51.686316 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d6346124-98bc-45dc-8017-e1eb38400401 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:51.686741 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d6346124-98bc-45dc-8017-e1eb38400401 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:51.909119 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-d6346124-98bc-45dc-8017-e1eb38400401 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:51.917613 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-d6346124-98bc-45dc-8017-e1eb38400401 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1736 microversion: 2.1 time: 0.250784 Sep 03 03:52:51.918204 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 278/554] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:51 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1736 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:52.469864 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-64756119-34d5-46ff-99a1-d749f96298fc tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:52.470469 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-64756119-34d5-46ff-99a1-d749f96298fc tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: f23f06ef-2db1-4e7b-a2f4-71927f83b40d] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:52.476943 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-64756119-34d5-46ff-99a1-d749f96298fc tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:52.477493 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-64756119-34d5-46ff-99a1-d749f96298fc tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:52.477945 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-64756119-34d5-46ff-99a1-d749f96298fc tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:52.478629 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-64756119-34d5-46ff-99a1-d749f96298fc tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:52.479102 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-64756119-34d5-46ff-99a1-d749f96298fc tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:52.479509 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-64756119-34d5-46ff-99a1-d749f96298fc tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:52.542281 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-64756119-34d5-46ff-99a1-d749f96298fc tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:52.550706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-64756119-34d5-46ff-99a1-d749f96298fc tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d" status: 200 len: 1613 microversion: 2.1 time: 0.084738 Sep 03 03:52:52.551410 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 277/555] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:52 2022] GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d => generated 1613 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:52.648265 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-c59857bb-c098-4bc6-8d5c-835ff84f051a req-5a322ce2-f0cd-48c3-a574-e117cec1b4df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f23f06ef-2db1-4e7b-a2f4-71927f83b40d", "name": "network-vif-deleted", "tag": "7375a989-9439-4258-b7ff-865576ed3c85"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:52:52.662875 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-c59857bb-c098-4bc6-8d5c-835ff84f051a req-5a322ce2-f0cd-48c3-a574-e117cec1b4df service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:52.663592 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-c59857bb-c098-4bc6-8d5c-835ff84f051a req-5a322ce2-f0cd-48c3-a574-e117cec1b4df service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:52.664234 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-c59857bb-c098-4bc6-8d5c-835ff84f051a req-5a322ce2-f0cd-48c3-a574-e117cec1b4df service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:52.676923 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-c59857bb-c098-4bc6-8d5c-835ff84f051a req-5a322ce2-f0cd-48c3-a574-e117cec1b4df service nova] Creating event network-vif-deleted:7375a989-9439-4258-b7ff-865576ed3c85 for instance f23f06ef-2db1-4e7b-a2f4-71927f83b40d on hv-cinder-79966 Sep 03 03:52:52.682013 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-c59857bb-c098-4bc6-8d5c-835ff84f051a req-5a322ce2-f0cd-48c3-a574-e117cec1b4df service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038052 Sep 03 03:52:52.682613 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 279/556] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:52:52.941602 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-33793aa1-3e41-4fb1-9853-a43b54cb7f65 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:52.942281 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-33793aa1-3e41-4fb1-9853-a43b54cb7f65 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:52.948838 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-33793aa1-3e41-4fb1-9853-a43b54cb7f65 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:52.949325 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-33793aa1-3e41-4fb1-9853-a43b54cb7f65 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:52.949757 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-33793aa1-3e41-4fb1-9853-a43b54cb7f65 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:52.950512 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-33793aa1-3e41-4fb1-9853-a43b54cb7f65 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:52.951023 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-33793aa1-3e41-4fb1-9853-a43b54cb7f65 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:52.951431 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-33793aa1-3e41-4fb1-9853-a43b54cb7f65 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:53.088262 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-33793aa1-3e41-4fb1-9853-a43b54cb7f65 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:53.096932 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-33793aa1-3e41-4fb1-9853-a43b54cb7f65 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1736 microversion: 2.1 time: 0.159165 Sep 03 03:52:53.097502 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 278/557] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:52 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:53.575257 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-18dbde41-469b-4090-9681-b040c29795cc tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:53.576017 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-18dbde41-469b-4090-9681-b040c29795cc tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: f23f06ef-2db1-4e7b-a2f4-71927f83b40d] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:53.582880 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-18dbde41-469b-4090-9681-b040c29795cc tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:53.583654 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-18dbde41-469b-4090-9681-b040c29795cc tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:53.584080 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-18dbde41-469b-4090-9681-b040c29795cc tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:53.584782 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-18dbde41-469b-4090-9681-b040c29795cc tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:53.585220 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-18dbde41-469b-4090-9681-b040c29795cc tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:53.585615 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-18dbde41-469b-4090-9681-b040c29795cc tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:53.658221 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-18dbde41-469b-4090-9681-b040c29795cc tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:53.667437 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-18dbde41-469b-4090-9681-b040c29795cc tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d" status: 200 len: 1613 microversion: 2.1 time: 0.096795 Sep 03 03:52:53.668031 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 280/558] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:53 2022] GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d => generated 1613 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:54.121333 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-c42cda34-b065-4cfb-a240-8132710fe7a0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:54.122042 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-c42cda34-b065-4cfb-a240-8132710fe7a0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:54.129482 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c42cda34-b065-4cfb-a240-8132710fe7a0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:54.129961 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c42cda34-b065-4cfb-a240-8132710fe7a0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:54.130475 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c42cda34-b065-4cfb-a240-8132710fe7a0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:54.131201 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c42cda34-b065-4cfb-a240-8132710fe7a0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:54.131646 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c42cda34-b065-4cfb-a240-8132710fe7a0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:54.132058 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c42cda34-b065-4cfb-a240-8132710fe7a0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:54.272060 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-c42cda34-b065-4cfb-a240-8132710fe7a0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:54.281186 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-c42cda34-b065-4cfb-a240-8132710fe7a0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1736 microversion: 2.1 time: 0.163858 Sep 03 03:52:54.281751 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 279/559] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:54 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:54.693563 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-aa111f6d-dcf6-44ed-8a8c-0f67dc606850 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:54.694175 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-aa111f6d-dcf6-44ed-8a8c-0f67dc606850 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: f23f06ef-2db1-4e7b-a2f4-71927f83b40d] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:54.701183 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-aa111f6d-dcf6-44ed-8a8c-0f67dc606850 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:54.701679 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-aa111f6d-dcf6-44ed-8a8c-0f67dc606850 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:54.702105 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-aa111f6d-dcf6-44ed-8a8c-0f67dc606850 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:54.702830 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-aa111f6d-dcf6-44ed-8a8c-0f67dc606850 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:54.703289 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-aa111f6d-dcf6-44ed-8a8c-0f67dc606850 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:54.703712 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-aa111f6d-dcf6-44ed-8a8c-0f67dc606850 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:54.772166 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-aa111f6d-dcf6-44ed-8a8c-0f67dc606850 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:54.781550 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-aa111f6d-dcf6-44ed-8a8c-0f67dc606850 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d" status: 200 len: 1325 microversion: 2.1 time: 0.091858 Sep 03 03:52:54.782313 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 281/560] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:54 2022] GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d => generated 1325 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:55.305046 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-192c17c0-3ab1-4d81-8bc8-87b777918f8a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:55.305664 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-192c17c0-3ab1-4d81-8bc8-87b777918f8a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:55.313106 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-192c17c0-3ab1-4d81-8bc8-87b777918f8a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:55.313588 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-192c17c0-3ab1-4d81-8bc8-87b777918f8a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:55.314014 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-192c17c0-3ab1-4d81-8bc8-87b777918f8a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:55.314762 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-192c17c0-3ab1-4d81-8bc8-87b777918f8a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:55.315242 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-192c17c0-3ab1-4d81-8bc8-87b777918f8a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:55.315652 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-192c17c0-3ab1-4d81-8bc8-87b777918f8a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:55.448141 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-192c17c0-3ab1-4d81-8bc8-87b777918f8a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:55.451713 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:52:55.457140 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-192c17c0-3ab1-4d81-8bc8-87b777918f8a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1736 microversion: 2.1 time: 0.156022 Sep 03 03:52:55.457697 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 280/561] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:55 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:55.805143 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-5a46be41-577e-4a99-a74b-4364184d8b3b tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:55.805565 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-5a46be41-577e-4a99-a74b-4364184d8b3b tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: f23f06ef-2db1-4e7b-a2f4-71927f83b40d] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:55.814469 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5a46be41-577e-4a99-a74b-4364184d8b3b tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:55.814999 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5a46be41-577e-4a99-a74b-4364184d8b3b tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:55.815416 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5a46be41-577e-4a99-a74b-4364184d8b3b tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:55.816116 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5a46be41-577e-4a99-a74b-4364184d8b3b tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:55.816808 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5a46be41-577e-4a99-a74b-4364184d8b3b tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:55.817278 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5a46be41-577e-4a99-a74b-4364184d8b3b tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:55.861525 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5a46be41-577e-4a99-a74b-4364184d8b3b tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:55.862225 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5a46be41-577e-4a99-a74b-4364184d8b3b tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:55.862783 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5a46be41-577e-4a99-a74b-4364184d8b3b tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:55.863123 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.objects.instance [None req-5a46be41-577e-4a99-a74b-4364184d8b3b tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lazy-loading 'fault' on Instance uuid f23f06ef-2db1-4e7b-a2f4-71927f83b40d {{(pid=132076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 03:52:55.904477 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-5a46be41-577e-4a99-a74b-4364184d8b3b tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:55.912353 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-5a46be41-577e-4a99-a74b-4364184d8b3b tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d" status: 200 len: 1330 microversion: 2.1 time: 0.111548 Sep 03 03:52:55.912932 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 282/562] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:55 2022] GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d => generated 1330 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:56.481448 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-7bc84d09-1b3f-4dec-aa52-124cf493d3ba tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:56.482393 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-7bc84d09-1b3f-4dec-aa52-124cf493d3ba tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:56.489193 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7bc84d09-1b3f-4dec-aa52-124cf493d3ba tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:56.489670 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7bc84d09-1b3f-4dec-aa52-124cf493d3ba tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:56.490123 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7bc84d09-1b3f-4dec-aa52-124cf493d3ba tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:56.490943 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7bc84d09-1b3f-4dec-aa52-124cf493d3ba tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:56.491564 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7bc84d09-1b3f-4dec-aa52-124cf493d3ba tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:56.491979 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7bc84d09-1b3f-4dec-aa52-124cf493d3ba tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:56.626046 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-7bc84d09-1b3f-4dec-aa52-124cf493d3ba tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:56.636084 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-7bc84d09-1b3f-4dec-aa52-124cf493d3ba tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1736 microversion: 2.1 time: 0.159461 Sep 03 03:52:56.636787 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 281/563] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:56 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:56.934854 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-2ac3671b-188c-44bc-b96e-9e4c7a92045d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:56.935447 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-2ac3671b-188c-44bc-b96e-9e4c7a92045d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: f23f06ef-2db1-4e7b-a2f4-71927f83b40d] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:56.941961 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-9dcf122e-62e0-4509-b681-c861499040c1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:52:56.942209 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2ac3671b-188c-44bc-b96e-9e4c7a92045d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:56.942691 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2ac3671b-188c-44bc-b96e-9e4c7a92045d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:56.943155 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2ac3671b-188c-44bc-b96e-9e4c7a92045d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:56.943903 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2ac3671b-188c-44bc-b96e-9e4c7a92045d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:56.944348 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2ac3671b-188c-44bc-b96e-9e4c7a92045d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:56.944806 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2ac3671b-188c-44bc-b96e-9e4c7a92045d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:56.948149 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9dcf122e-62e0-4509-b681-c861499040c1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:56.948674 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9dcf122e-62e0-4509-b681-c861499040c1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:56.949173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9dcf122e-62e0-4509-b681-c861499040c1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:56.958549 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.wsgi [None req-2ac3671b-188c-44bc-b96e-9e4c7a92045d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] HTTP exception thrown: Instance f23f06ef-2db1-4e7b-a2f4-71927f83b40d could not be found. Sep 03 03:52:56.960276 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-2ac3671b-188c-44bc-b96e-9e4c7a92045d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Request method failure captured: Sep 03 03:52:56.960276 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: request: GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d HTTP/1.1 Sep 03 03:52:56.960276 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept: application/json Sep 03 03:52:56.960276 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept-Encoding: identity Sep 03 03:52:56.960276 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Connection: close Sep 03 03:52:56.960276 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Length: 0 Sep 03 03:52:56.960276 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Type: application/json Sep 03 03:52:56.960276 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Host: 10.222.0.25 Sep 03 03:52:56.960276 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Openstack-System-Scope: None Sep 03 03:52:56.960276 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: User-Agent: python-urllib3/1.26.12 Sep 03 03:52:56.960276 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Auth-Token: gAAAAABjEs650LfhdeTARTcps2T6trtQQt2m5icunzzvIWer-eUYgJYZG5Pjv6m6uWkZdMglMW7-SwnvvwA9dyIFe0GhqjthXj4rFLg5_wGV22DwN7Tu1nE8T--OP86NZDND7AUMPsZwRHed6vQjd_qeShmm1sU59yMmrfP4r0ItLtiNkEQOrd0 Sep 03 03:52:56.960276 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Id: None Sep 03 03:52:56.960276 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Name: None Sep 03 03:52:56.960276 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Identity-Status: Confirmed Sep 03 03:52:56.960276 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Is-Admin-Project: True Sep 03 03:52:56.960276 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Id: default Sep 03 03:52:56.960276 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Name: Default Sep 03 03:52:56.960276 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Id: ac9e77355ba040bda4f2186753df7b24 Sep 03 03:52:56.960276 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Name: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:52:56.960276 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Role: member,reader Sep 03 03:52:56.960276 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Roles: member,reader Sep 03 03:52:56.961805 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:52:56.961805 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:52:56.961805 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Id: ac9e77355ba040bda4f2186753df7b24 Sep 03 03:52:56.961805 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:52:56.961805 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User: tempest-AttachVolumeNegativeTest-1116033749-project Sep 03 03:52:56.961805 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Id: default Sep 03 03:52:56.961805 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Name: Default Sep 03 03:52:56.961805 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Id: 1dde7fad075145c89f726ca85c6c00ba Sep 03 03:52:56.961805 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Name: tempest-AttachVolumeNegativeTest-1116033749-project Sep 03 03:52:56.961805 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: method: > Sep 03 03:52:56.961805 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: exception: Instance f23f06ef-2db1-4e7b-a2f4-71927f83b40d could not be found. Sep 03 03:52:56.961805 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: action_args: {'id': 'f23f06ef-2db1-4e7b-a2f4-71927f83b40d'} Sep 03 03:52:56.962652 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:52:56.962652 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:52:56.962652 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 03:52:56.962652 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 03:52:56.962652 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 03:52:56.962652 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 03:52:56.962652 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 03:52:56.962652 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 03:52:56.962652 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 03:52:56.962652 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 03:52:56.962652 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f23f06ef-2db1-4e7b-a2f4-71927f83b40d could not be found. Sep 03 03:52:56.962652 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:52:56.962652 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:52:56.962652 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:52:56.962652 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:52:56.962652 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:52:56.962652 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:52:56.962652 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:52:56.962652 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:52:56.962652 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:52:56.964039 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:52:56.964039 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 03:52:56.964039 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 03:52:56.964039 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 03:52:56.964039 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 03:52:56.964039 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 03:52:56.964039 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:52:56.964039 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f23f06ef-2db1-4e7b-a2f4-71927f83b40d could not be found. Sep 03 03:52:56.964039 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:52:56.964039 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:52:56.964039 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:52:56.964039 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:52:56.964039 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:52:56.964039 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:52:56.964039 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:52:56.964039 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:52:56.964039 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f23f06ef-2db1-4e7b-a2f4-71927f83b40d could not be found. Sep 03 03:52:56.964039 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:52:56.965343 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-2ac3671b-188c-44bc-b96e-9e4c7a92045d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Returning 404 to user: Instance f23f06ef-2db1-4e7b-a2f4-71927f83b40d could not be found. {{(pid=132076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:52:56.965343 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-2ac3671b-188c-44bc-b96e-9e4c7a92045d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d" status: 404 len: 111 microversion: 2.1 time: 0.030838 Sep 03 03:52:56.965343 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 283/564] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:56 2022] GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 03:52:56.970579 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-b6224c7e-55f1-4e74-9864-87355937dc4b tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '.version_select at 0x7f45fc621b80>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:56.976123 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-9dcf122e-62e0-4509-b681-c861499040c1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Going to try to stop instance {{(pid=132077) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 03 03:52:56.993103 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-b6224c7e-55f1-4e74-9864-87355937dc4b tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-465855499" status: 202 len: 0 microversion: 2.1 time: 0.026050 Sep 03 03:52:56.993684 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 284/565] 10.222.0.25 () {58 vars in 1218 bytes} [Sat Sep 3 03:52:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-465855499 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 03:52:57.021482 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-9dcf122e-62e0-4509-b681-c861499040c1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "POST /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731/action" status: 202 len: 0 microversion: 2.1 time: 0.083129 Sep 03 03:52:57.022333 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 282/566] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Sep 3 03:52:56 2022] POST /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 03:52:57.030747 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-959de192-971b-45a0-9e1c-f91a2c6ab91c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:57.031367 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-959de192-971b-45a0-9e1c-f91a2c6ab91c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:57.039224 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-959de192-971b-45a0-9e1c-f91a2c6ab91c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:57.039738 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-959de192-971b-45a0-9e1c-f91a2c6ab91c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:57.040337 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-959de192-971b-45a0-9e1c-f91a2c6ab91c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:57.041296 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-959de192-971b-45a0-9e1c-f91a2c6ab91c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:57.041940 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-959de192-971b-45a0-9e1c-f91a2c6ab91c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:57.042558 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-959de192-971b-45a0-9e1c-f91a2c6ab91c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:57.047347 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:52:57.223400 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-959de192-971b-45a0-9e1c-f91a2c6ab91c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:57.232526 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-959de192-971b-45a0-9e1c-f91a2c6ab91c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1678 microversion: 2.1 time: 0.205561 Sep 03 03:52:57.233470 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 285/567] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:57 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1678 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:57.669430 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-3734492a-6791-40aa-bd08-31d9b419e211 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:57.670177 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-3734492a-6791-40aa-bd08-31d9b419e211 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:57.676826 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3734492a-6791-40aa-bd08-31d9b419e211 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:57.677299 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3734492a-6791-40aa-bd08-31d9b419e211 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:57.677730 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3734492a-6791-40aa-bd08-31d9b419e211 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:57.678419 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3734492a-6791-40aa-bd08-31d9b419e211 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:57.678884 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3734492a-6791-40aa-bd08-31d9b419e211 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:57.679295 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3734492a-6791-40aa-bd08-31d9b419e211 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:57.726543 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-d5d263a1-88af-4c9a-8d30-1793462a4a20 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:57.727060 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-d5d263a1-88af-4c9a-8d30-1793462a4a20 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:57.733587 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d5d263a1-88af-4c9a-8d30-1793462a4a20 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:57.734069 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d5d263a1-88af-4c9a-8d30-1793462a4a20 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:57.734483 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d5d263a1-88af-4c9a-8d30-1793462a4a20 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:57.735195 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d5d263a1-88af-4c9a-8d30-1793462a4a20 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:57.735641 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d5d263a1-88af-4c9a-8d30-1793462a4a20 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:57.736057 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d5d263a1-88af-4c9a-8d30-1793462a4a20 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:57.810212 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-3734492a-6791-40aa-bd08-31d9b419e211 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:57.818678 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-3734492a-6791-40aa-bd08-31d9b419e211 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1736 microversion: 2.1 time: 0.159223 Sep 03 03:52:57.819267 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 283/568] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:57 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:57.860719 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.objects.instance [None req-d5d263a1-88af-4c9a-8d30-1793462a4a20 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lazy-loading 'services' on Instance uuid 69fe618d-1192-4541-9d90-e5cee06be911 {{(pid=132076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 03:52:57.975843 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-d5d263a1-88af-4c9a-8d30-1793462a4a20 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "DELETE /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911/os-volume_attachments/b44551c4-c873-436b-92b6-0e253b28976e" status: 202 len: 0 microversion: 2.1 time: 0.253018 Sep 03 03:52:57.976478 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 286/569] 10.222.0.25 () {58 vars in 1416 bytes} [Sat Sep 3 03:52:57 2022] DELETE /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911/os-volume_attachments/b44551c4-c873-436b-92b6-0e253b28976e => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 03 03:52:57.985778 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-321d08ce-0a78-4e69-9379-4e6ceed1566e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:57.988067 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-321d08ce-0a78-4e69-9379-4e6ceed1566e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:57.994280 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-321d08ce-0a78-4e69-9379-4e6ceed1566e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:57.994758 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-321d08ce-0a78-4e69-9379-4e6ceed1566e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:57.995224 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-321d08ce-0a78-4e69-9379-4e6ceed1566e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:57.995906 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-321d08ce-0a78-4e69-9379-4e6ceed1566e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:57.996347 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-321d08ce-0a78-4e69-9379-4e6ceed1566e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:57.996757 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-321d08ce-0a78-4e69-9379-4e6ceed1566e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:58.026247 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-321d08ce-0a78-4e69-9379-4e6ceed1566e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045266 Sep 03 03:52:58.026789 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 284/570] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Sep 3 03:52:57 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:52:58.256316 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-6e56e02b-12be-4256-96ba-b3a3b63544a1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:58.257019 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-6e56e02b-12be-4256-96ba-b3a3b63544a1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:58.264220 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6e56e02b-12be-4256-96ba-b3a3b63544a1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:58.264694 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6e56e02b-12be-4256-96ba-b3a3b63544a1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:58.265121 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6e56e02b-12be-4256-96ba-b3a3b63544a1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:58.265802 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6e56e02b-12be-4256-96ba-b3a3b63544a1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:58.266242 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6e56e02b-12be-4256-96ba-b3a3b63544a1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:58.266658 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6e56e02b-12be-4256-96ba-b3a3b63544a1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:58.401704 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-6e56e02b-12be-4256-96ba-b3a3b63544a1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:58.409407 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-6e56e02b-12be-4256-96ba-b3a3b63544a1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1678 microversion: 2.1 time: 0.157324 Sep 03 03:52:58.409966 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 287/571] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:58 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:58.845374 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-05d7bc0f-3ae1-4156-a441-e0493af8e16a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:58.846324 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-05d7bc0f-3ae1-4156-a441-e0493af8e16a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:58.857034 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-05d7bc0f-3ae1-4156-a441-e0493af8e16a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:58.857543 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-05d7bc0f-3ae1-4156-a441-e0493af8e16a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:58.857972 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-05d7bc0f-3ae1-4156-a441-e0493af8e16a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:58.858659 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-05d7bc0f-3ae1-4156-a441-e0493af8e16a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:58.859130 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-05d7bc0f-3ae1-4156-a441-e0493af8e16a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:58.859549 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-05d7bc0f-3ae1-4156-a441-e0493af8e16a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:58.989425 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-05d7bc0f-3ae1-4156-a441-e0493af8e16a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:59.002014 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-05d7bc0f-3ae1-4156-a441-e0493af8e16a tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1736 microversion: 2.1 time: 0.162822 Sep 03 03:52:59.002797 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 285/572] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:58 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:52:59.038930 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-ac659f6e-9f17-4635-8a46-bdf4409d9a58 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:59.041136 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-ac659f6e-9f17-4635-8a46-bdf4409d9a58 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:59.049793 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ac659f6e-9f17-4635-8a46-bdf4409d9a58 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:59.050493 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ac659f6e-9f17-4635-8a46-bdf4409d9a58 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:59.051133 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ac659f6e-9f17-4635-8a46-bdf4409d9a58 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:59.052066 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ac659f6e-9f17-4635-8a46-bdf4409d9a58 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:59.052611 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ac659f6e-9f17-4635-8a46-bdf4409d9a58 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:59.053172 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ac659f6e-9f17-4635-8a46-bdf4409d9a58 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:59.083842 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-ac659f6e-9f17-4635-8a46-bdf4409d9a58 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048864 Sep 03 03:52:59.084417 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 288/573] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Sep 3 03:52:59 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:52:59.436614 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-b54d8c7e-cf1e-4b79-8139-0882a4855301 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:52:59.437584 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-b54d8c7e-cf1e-4b79-8139-0882a4855301 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:52:59.447728 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b54d8c7e-cf1e-4b79-8139-0882a4855301 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:59.448514 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b54d8c7e-cf1e-4b79-8139-0882a4855301 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:59.449220 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b54d8c7e-cf1e-4b79-8139-0882a4855301 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:59.450323 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b54d8c7e-cf1e-4b79-8139-0882a4855301 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:52:59.450752 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b54d8c7e-cf1e-4b79-8139-0882a4855301 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:52:59.451220 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b54d8c7e-cf1e-4b79-8139-0882a4855301 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:52:59.584307 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-b54d8c7e-cf1e-4b79-8139-0882a4855301 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:52:59.595867 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-b54d8c7e-cf1e-4b79-8139-0882a4855301 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1678 microversion: 2.1 time: 0.165354 Sep 03 03:52:59.596680 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 286/574] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:52:59 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:00.031605 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-e8a97e03-2fe4-4895-88d8-8cd8f4248ee9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:00.032197 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-e8a97e03-2fe4-4895-88d8-8cd8f4248ee9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:00.038432 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e8a97e03-2fe4-4895-88d8-8cd8f4248ee9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:00.038963 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e8a97e03-2fe4-4895-88d8-8cd8f4248ee9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:00.039579 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e8a97e03-2fe4-4895-88d8-8cd8f4248ee9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:00.040049 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e8a97e03-2fe4-4895-88d8-8cd8f4248ee9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:00.040524 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e8a97e03-2fe4-4895-88d8-8cd8f4248ee9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:00.040937 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e8a97e03-2fe4-4895-88d8-8cd8f4248ee9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:00.096629 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-36058918-d64e-4b17-af3c-68f90b9fd81a tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:00.098785 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-36058918-d64e-4b17-af3c-68f90b9fd81a tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:00.105230 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-36058918-d64e-4b17-af3c-68f90b9fd81a tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:00.105711 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-36058918-d64e-4b17-af3c-68f90b9fd81a tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:00.106113 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-36058918-d64e-4b17-af3c-68f90b9fd81a tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:00.107186 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-36058918-d64e-4b17-af3c-68f90b9fd81a tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:00.107634 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-36058918-d64e-4b17-af3c-68f90b9fd81a tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:00.108051 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-36058918-d64e-4b17-af3c-68f90b9fd81a tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:00.140230 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-36058918-d64e-4b17-af3c-68f90b9fd81a tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047568 Sep 03 03:53:00.140786 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 287/575] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Sep 3 03:53:00 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:53:00.175702 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-e8a97e03-2fe4-4895-88d8-8cd8f4248ee9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:00.184037 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-e8a97e03-2fe4-4895-88d8-8cd8f4248ee9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1736 microversion: 2.1 time: 0.156964 Sep 03 03:53:00.184635 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 289/576] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:00 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:00.619328 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-1d119ad8-2382-4836-bf12-6b02de38295e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:00.620051 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-1d119ad8-2382-4836-bf12-6b02de38295e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:00.626310 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1d119ad8-2382-4836-bf12-6b02de38295e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:00.626782 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1d119ad8-2382-4836-bf12-6b02de38295e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:00.627227 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1d119ad8-2382-4836-bf12-6b02de38295e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:00.627906 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1d119ad8-2382-4836-bf12-6b02de38295e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:00.628350 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1d119ad8-2382-4836-bf12-6b02de38295e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:00.628760 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1d119ad8-2382-4836-bf12-6b02de38295e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:00.756897 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-1d119ad8-2382-4836-bf12-6b02de38295e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:00.765057 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-1d119ad8-2382-4836-bf12-6b02de38295e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1678 microversion: 2.1 time: 0.149534 Sep 03 03:53:00.765842 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 288/577] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:00 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:01.157261 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-fdb1b9e3-3c0d-47f5-b885-afecf6335a56 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:01.160664 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-fdb1b9e3-3c0d-47f5-b885-afecf6335a56 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:01.170444 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fdb1b9e3-3c0d-47f5-b885-afecf6335a56 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:01.170942 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fdb1b9e3-3c0d-47f5-b885-afecf6335a56 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:01.171404 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fdb1b9e3-3c0d-47f5-b885-afecf6335a56 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:01.172098 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fdb1b9e3-3c0d-47f5-b885-afecf6335a56 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:01.172547 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fdb1b9e3-3c0d-47f5-b885-afecf6335a56 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:01.172967 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fdb1b9e3-3c0d-47f5-b885-afecf6335a56 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:01.213370 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-fdb1b9e3-3c0d-47f5-b885-afecf6335a56 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062892 Sep 03 03:53:01.213731 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-38dafe5c-ff09-4d82-b492-f0573f77cb0f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:01.214199 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 290/578] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Sep 3 03:53:01 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 03:53:01.214320 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-38dafe5c-ff09-4d82-b492-f0573f77cb0f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:01.217035 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_api:SELECT=72 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:53:01.223005 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-38dafe5c-ff09-4d82-b492-f0573f77cb0f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:01.223486 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-38dafe5c-ff09-4d82-b492-f0573f77cb0f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:01.223906 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-38dafe5c-ff09-4d82-b492-f0573f77cb0f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:01.224588 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-38dafe5c-ff09-4d82-b492-f0573f77cb0f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:01.225032 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-38dafe5c-ff09-4d82-b492-f0573f77cb0f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:01.225446 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-38dafe5c-ff09-4d82-b492-f0573f77cb0f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:01.279511 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-636c7c06-1810-46cd-a065-a54acdcfcea4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:01.279995 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-636c7c06-1810-46cd-a065-a54acdcfcea4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:01.286210 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-636c7c06-1810-46cd-a065-a54acdcfcea4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:01.286673 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-636c7c06-1810-46cd-a065-a54acdcfcea4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:01.287142 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-636c7c06-1810-46cd-a065-a54acdcfcea4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:01.287824 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-636c7c06-1810-46cd-a065-a54acdcfcea4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:01.288271 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-636c7c06-1810-46cd-a065-a54acdcfcea4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:01.288686 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-636c7c06-1810-46cd-a065-a54acdcfcea4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:01.313244 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-636c7c06-1810-46cd-a065-a54acdcfcea4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Going to try to terminate instance {{(pid=132076) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 03:53:01.364370 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-38dafe5c-ff09-4d82-b492-f0573f77cb0f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:01.373327 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-38dafe5c-ff09-4d82-b492-f0573f77cb0f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1736 microversion: 2.1 time: 0.163503 Sep 03 03:53:01.373896 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 289/579] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:01 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:53:01.391296 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-636c7c06-1810-46cd-a065-a54acdcfcea4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "DELETE /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911" status: 204 len: 0 microversion: 2.1 time: 0.115154 Sep 03 03:53:01.391873 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 291/580] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Sep 3 03:53:01 2022] DELETE /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 03 03:53:01.400407 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-024c6460-4346-49c6-afe2-5a27ec38de26 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:01.401002 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-024c6460-4346-49c6-afe2-5a27ec38de26 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:01.407581 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-024c6460-4346-49c6-afe2-5a27ec38de26 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:01.407985 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-024c6460-4346-49c6-afe2-5a27ec38de26 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:01.408404 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-024c6460-4346-49c6-afe2-5a27ec38de26 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:01.409094 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-024c6460-4346-49c6-afe2-5a27ec38de26 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:01.409537 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-024c6460-4346-49c6-afe2-5a27ec38de26 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:01.409943 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-024c6460-4346-49c6-afe2-5a27ec38de26 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:01.540627 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-024c6460-4346-49c6-afe2-5a27ec38de26 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:01.548726 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-024c6460-4346-49c6-afe2-5a27ec38de26 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911" status: 200 len: 1679 microversion: 2.1 time: 0.152063 Sep 03 03:53:01.549305 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 290/581] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:01 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:01.790533 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-47d972bc-92d0-44d2-8e10-5c80752ae37d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:01.791254 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-47d972bc-92d0-44d2-8e10-5c80752ae37d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:01.797719 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-47d972bc-92d0-44d2-8e10-5c80752ae37d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:01.798211 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-47d972bc-92d0-44d2-8e10-5c80752ae37d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:01.798644 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-47d972bc-92d0-44d2-8e10-5c80752ae37d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:01.799382 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-47d972bc-92d0-44d2-8e10-5c80752ae37d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:01.799835 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-47d972bc-92d0-44d2-8e10-5c80752ae37d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:01.800262 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-47d972bc-92d0-44d2-8e10-5c80752ae37d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:01.945453 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-47d972bc-92d0-44d2-8e10-5c80752ae37d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:01.953599 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-47d972bc-92d0-44d2-8e10-5c80752ae37d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1678 microversion: 2.1 time: 0.167475 Sep 03 03:53:01.954151 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 292/582] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:01 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:02.401131 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-7e09a6e4-582a-4a08-b130-c0763de407d8 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:02.401983 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-7e09a6e4-582a-4a08-b130-c0763de407d8 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:02.409485 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7e09a6e4-582a-4a08-b130-c0763de407d8 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:02.409965 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7e09a6e4-582a-4a08-b130-c0763de407d8 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:02.410396 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7e09a6e4-582a-4a08-b130-c0763de407d8 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:02.411150 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7e09a6e4-582a-4a08-b130-c0763de407d8 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:02.411600 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7e09a6e4-582a-4a08-b130-c0763de407d8 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:02.412021 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7e09a6e4-582a-4a08-b130-c0763de407d8 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:02.572362 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-108ce0b7-0487-4eeb-ae8f-4e1c92a049a1 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:02.572945 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-108ce0b7-0487-4eeb-ae8f-4e1c92a049a1 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:02.580368 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-108ce0b7-0487-4eeb-ae8f-4e1c92a049a1 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:02.580970 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-108ce0b7-0487-4eeb-ae8f-4e1c92a049a1 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:02.581498 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-108ce0b7-0487-4eeb-ae8f-4e1c92a049a1 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:02.582284 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-108ce0b7-0487-4eeb-ae8f-4e1c92a049a1 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:02.582836 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-108ce0b7-0487-4eeb-ae8f-4e1c92a049a1 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:02.583270 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-108ce0b7-0487-4eeb-ae8f-4e1c92a049a1 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:02.721620 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-108ce0b7-0487-4eeb-ae8f-4e1c92a049a1 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:02.729643 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-108ce0b7-0487-4eeb-ae8f-4e1c92a049a1 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911" status: 200 len: 1679 microversion: 2.1 time: 0.161192 Sep 03 03:53:02.730182 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 293/583] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:02 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:02.754217 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-7e09a6e4-582a-4a08-b130-c0763de407d8 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:02.762858 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-7e09a6e4-582a-4a08-b130-c0763de407d8 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1736 microversion: 2.1 time: 0.367821 Sep 03 03:53:02.763429 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 291/584] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:02 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1736 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:02.981537 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-48e4b421-cdda-4475-bc51-8f3708eb9af8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:02.982878 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-48e4b421-cdda-4475-bc51-8f3708eb9af8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:02.992955 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-48e4b421-cdda-4475-bc51-8f3708eb9af8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:02.994131 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-48e4b421-cdda-4475-bc51-8f3708eb9af8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:02.994870 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-48e4b421-cdda-4475-bc51-8f3708eb9af8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:02.996020 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-48e4b421-cdda-4475-bc51-8f3708eb9af8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:02.996889 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-48e4b421-cdda-4475-bc51-8f3708eb9af8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:02.997310 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-48e4b421-cdda-4475-bc51-8f3708eb9af8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:03.131326 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-48e4b421-cdda-4475-bc51-8f3708eb9af8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:03.143437 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-48e4b421-cdda-4475-bc51-8f3708eb9af8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1678 microversion: 2.1 time: 0.168238 Sep 03 03:53:03.144294 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 294/585] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:02 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:03.756592 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-59eb6d13-8e0c-4342-9e08-66010ba0d8e9 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:03.757332 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-59eb6d13-8e0c-4342-9e08-66010ba0d8e9 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:03.766735 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-59eb6d13-8e0c-4342-9e08-66010ba0d8e9 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:03.767434 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-59eb6d13-8e0c-4342-9e08-66010ba0d8e9 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:03.768006 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-59eb6d13-8e0c-4342-9e08-66010ba0d8e9 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:03.768943 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-59eb6d13-8e0c-4342-9e08-66010ba0d8e9 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:03.769547 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-59eb6d13-8e0c-4342-9e08-66010ba0d8e9 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:03.770112 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-59eb6d13-8e0c-4342-9e08-66010ba0d8e9 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:03.787114 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-7b4c49a7-bfcd-4bcc-b346-43afe373a7fe tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:03.787724 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-7b4c49a7-bfcd-4bcc-b346-43afe373a7fe tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:03.793990 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7b4c49a7-bfcd-4bcc-b346-43afe373a7fe tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:03.794465 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7b4c49a7-bfcd-4bcc-b346-43afe373a7fe tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:03.794912 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7b4c49a7-bfcd-4bcc-b346-43afe373a7fe tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:03.795600 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7b4c49a7-bfcd-4bcc-b346-43afe373a7fe tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:03.796041 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7b4c49a7-bfcd-4bcc-b346-43afe373a7fe tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:03.796453 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7b4c49a7-bfcd-4bcc-b346-43afe373a7fe tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:03.909175 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-59eb6d13-8e0c-4342-9e08-66010ba0d8e9 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:03.917570 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-59eb6d13-8e0c-4342-9e08-66010ba0d8e9 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911" status: 200 len: 1679 microversion: 2.1 time: 0.166603 Sep 03 03:53:03.918145 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 292/586] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:03 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:03.971443 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-7b4c49a7-bfcd-4bcc-b346-43afe373a7fe tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:03.979530 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-7b4c49a7-bfcd-4bcc-b346-43afe373a7fe tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1736 microversion: 2.1 time: 0.196844 Sep 03 03:53:03.980155 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 295/587] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:03 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1736 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:04.126018 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-0ce86d25-7866-4f3e-a758-b357cd72f22c tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:04.126677 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-0ce86d25-7866-4f3e-a758-b357cd72f22c tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 4debbf95-0ffb-408e-bc62-12015a742cff] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:04.132799 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0ce86d25-7866-4f3e-a758-b357cd72f22c tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:04.133279 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0ce86d25-7866-4f3e-a758-b357cd72f22c tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:04.133699 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0ce86d25-7866-4f3e-a758-b357cd72f22c tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:04.134387 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0ce86d25-7866-4f3e-a758-b357cd72f22c tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:04.134828 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0ce86d25-7866-4f3e-a758-b357cd72f22c tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:04.135337 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0ce86d25-7866-4f3e-a758-b357cd72f22c tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:04.167640 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-a1ea14a8-dff7-4a24-bf08-6226fc28100d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:04.168267 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-a1ea14a8-dff7-4a24-bf08-6226fc28100d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:04.174758 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a1ea14a8-dff7-4a24-bf08-6226fc28100d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:04.175282 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a1ea14a8-dff7-4a24-bf08-6226fc28100d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:04.175712 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a1ea14a8-dff7-4a24-bf08-6226fc28100d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:04.176409 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a1ea14a8-dff7-4a24-bf08-6226fc28100d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:04.176859 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a1ea14a8-dff7-4a24-bf08-6226fc28100d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:04.177497 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a1ea14a8-dff7-4a24-bf08-6226fc28100d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:04.218116 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.objects.instance [None req-0ce86d25-7866-4f3e-a758-b357cd72f22c tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lazy-loading 'services' on Instance uuid 4debbf95-0ffb-408e-bc62-12015a742cff {{(pid=132077) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 03:53:04.297500 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-0ce86d25-7866-4f3e-a758-b357cd72f22c tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff/os-volume_attachments/4d7784fa-4460-47a6-82a9-40d3289be49c" status: 202 len: 0 microversion: 2.1 time: 0.175059 Sep 03 03:53:04.298050 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 293/588] 10.222.0.25 () {58 vars in 1416 bytes} [Sat Sep 3 03:53:04 2022] DELETE /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff/os-volume_attachments/4d7784fa-4460-47a6-82a9-40d3289be49c => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 03:53:04.442269 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-a1ea14a8-dff7-4a24-bf08-6226fc28100d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:04.450043 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-a1ea14a8-dff7-4a24-bf08-6226fc28100d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1678 microversion: 2.1 time: 0.286549 Sep 03 03:53:04.450889 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 296/589] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:04 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1678 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:53:04.942085 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-92d938b2-3d6a-4a1f-aff3-7821d81e5e34 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:04.943641 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-92d938b2-3d6a-4a1f-aff3-7821d81e5e34 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:04.950854 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-92d938b2-3d6a-4a1f-aff3-7821d81e5e34 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:04.951644 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-92d938b2-3d6a-4a1f-aff3-7821d81e5e34 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:04.952044 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-92d938b2-3d6a-4a1f-aff3-7821d81e5e34 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:04.952780 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-92d938b2-3d6a-4a1f-aff3-7821d81e5e34 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:04.953226 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-92d938b2-3d6a-4a1f-aff3-7821d81e5e34 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:04.953638 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-92d938b2-3d6a-4a1f-aff3-7821d81e5e34 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:05.003631 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-4fbdfc9a-65f9-4268-bf1d-1b0b71bfcd84 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:05.004840 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-4fbdfc9a-65f9-4268-bf1d-1b0b71bfcd84 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:05.018280 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4fbdfc9a-65f9-4268-bf1d-1b0b71bfcd84 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:05.025244 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4fbdfc9a-65f9-4268-bf1d-1b0b71bfcd84 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:05.025801 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4fbdfc9a-65f9-4268-bf1d-1b0b71bfcd84 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:05.026588 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4fbdfc9a-65f9-4268-bf1d-1b0b71bfcd84 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:05.027098 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4fbdfc9a-65f9-4268-bf1d-1b0b71bfcd84 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:05.027729 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4fbdfc9a-65f9-4268-bf1d-1b0b71bfcd84 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:05.051910 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-92d938b2-3d6a-4a1f-aff3-7821d81e5e34 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:05.067591 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-92d938b2-3d6a-4a1f-aff3-7821d81e5e34 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911" status: 200 len: 1612 microversion: 2.1 time: 0.127506 Sep 03 03:53:05.068866 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 294/590] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:04 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 => generated 1612 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:05.161951 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-8e9294f7-4ba9-4355-bca3-4f045c5264bf req-f694b9db-363a-4fc0-9d75-bf1d19777108 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69fe618d-1192-4541-9d90-e5cee06be911", "name": "network-vif-deleted", "tag": "1197b605-d728-4d04-90d2-9befd8120dd4"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:53:05.173818 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-8e9294f7-4ba9-4355-bca3-4f045c5264bf req-f694b9db-363a-4fc0-9d75-bf1d19777108 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:05.174633 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-8e9294f7-4ba9-4355-bca3-4f045c5264bf req-f694b9db-363a-4fc0-9d75-bf1d19777108 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:05.175242 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-8e9294f7-4ba9-4355-bca3-4f045c5264bf req-f694b9db-363a-4fc0-9d75-bf1d19777108 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:05.199435 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-8e9294f7-4ba9-4355-bca3-4f045c5264bf req-f694b9db-363a-4fc0-9d75-bf1d19777108 service nova] Creating event network-vif-deleted:1197b605-d728-4d04-90d2-9befd8120dd4 for instance 69fe618d-1192-4541-9d90-e5cee06be911 on hv-cinder-79966 Sep 03 03:53:05.206185 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-8e9294f7-4ba9-4355-bca3-4f045c5264bf req-f694b9db-363a-4fc0-9d75-bf1d19777108 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048415 Sep 03 03:53:05.207075 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 295/591] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 03:53:05.229971 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-4fbdfc9a-65f9-4268-bf1d-1b0b71bfcd84 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:05.247560 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-4fbdfc9a-65f9-4268-bf1d-1b0b71bfcd84 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1736 microversion: 2.1 time: 0.240153 Sep 03 03:53:05.248743 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 297/592] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:04 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1736 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:53:05.433326 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-850f6ff6-11f2-449a-87fa-38ec6d1a71f9 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:05.434309 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-850f6ff6-11f2-449a-87fa-38ec6d1a71f9 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 4debbf95-0ffb-408e-bc62-12015a742cff] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:05.441828 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-850f6ff6-11f2-449a-87fa-38ec6d1a71f9 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:05.442482 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-850f6ff6-11f2-449a-87fa-38ec6d1a71f9 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:05.443017 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-850f6ff6-11f2-449a-87fa-38ec6d1a71f9 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:05.443820 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-850f6ff6-11f2-449a-87fa-38ec6d1a71f9 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:05.444450 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-850f6ff6-11f2-449a-87fa-38ec6d1a71f9 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:05.445174 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-850f6ff6-11f2-449a-87fa-38ec6d1a71f9 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:05.465073 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:53:05.472681 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-850f6ff6-11f2-449a-87fa-38ec6d1a71f9 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 4debbf95-0ffb-408e-bc62-12015a742cff] Going to try to terminate instance {{(pid=132077) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 03:53:05.473502 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-2da56f31-b524-430f-a799-0195fada4b56 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:05.474096 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-2da56f31-b524-430f-a799-0195fada4b56 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:05.483209 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2da56f31-b524-430f-a799-0195fada4b56 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:05.483689 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2da56f31-b524-430f-a799-0195fada4b56 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:05.484115 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2da56f31-b524-430f-a799-0195fada4b56 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:05.484972 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2da56f31-b524-430f-a799-0195fada4b56 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:05.485443 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2da56f31-b524-430f-a799-0195fada4b56 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:05.485855 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2da56f31-b524-430f-a799-0195fada4b56 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:05.566836 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-850f6ff6-11f2-449a-87fa-38ec6d1a71f9 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff" status: 204 len: 0 microversion: 2.1 time: 0.137850 Sep 03 03:53:05.567759 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 296/593] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Sep 3 03:53:05 2022] DELETE /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 03:53:05.576675 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-292cddae-2191-4f49-9a38-4616b7cecfc0 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:05.577694 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-292cddae-2191-4f49-9a38-4616b7cecfc0 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 4debbf95-0ffb-408e-bc62-12015a742cff] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:05.585215 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-292cddae-2191-4f49-9a38-4616b7cecfc0 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:05.585967 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-292cddae-2191-4f49-9a38-4616b7cecfc0 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:05.586832 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-292cddae-2191-4f49-9a38-4616b7cecfc0 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:05.587501 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-292cddae-2191-4f49-9a38-4616b7cecfc0 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:05.588198 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-292cddae-2191-4f49-9a38-4616b7cecfc0 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:05.588725 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-292cddae-2191-4f49-9a38-4616b7cecfc0 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:05.665536 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-2da56f31-b524-430f-a799-0195fada4b56 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:05.673296 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-2da56f31-b524-430f-a799-0195fada4b56 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1678 microversion: 2.1 time: 0.203591 Sep 03 03:53:05.673865 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 298/594] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:05 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1678 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:05.741642 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-292cddae-2191-4f49-9a38-4616b7cecfc0 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0647075204ba183fb1e5beb2c5930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bafae6685e248d2ac4fab672648e941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:05.749921 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-292cddae-2191-4f49-9a38-4616b7cecfc0 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "GET /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff" status: 200 len: 1513 microversion: 2.1 time: 0.177967 Sep 03 03:53:05.750589 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 297/595] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:05 2022] GET /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff => generated 1513 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:06.096378 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-0ed7c744-1b33-424e-9742-a7314209e2f6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:06.097053 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-0ed7c744-1b33-424e-9742-a7314209e2f6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:06.103984 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0ed7c744-1b33-424e-9742-a7314209e2f6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:06.104462 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0ed7c744-1b33-424e-9742-a7314209e2f6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:06.104857 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0ed7c744-1b33-424e-9742-a7314209e2f6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:06.105562 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0ed7c744-1b33-424e-9742-a7314209e2f6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:06.106000 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0ed7c744-1b33-424e-9742-a7314209e2f6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:06.106415 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0ed7c744-1b33-424e-9742-a7314209e2f6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:06.126087 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:53:06.141658 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0ed7c744-1b33-424e-9742-a7314209e2f6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:06.142315 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0ed7c744-1b33-424e-9742-a7314209e2f6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:06.143369 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0ed7c744-1b33-424e-9742-a7314209e2f6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:06.143369 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.objects.instance [None req-0ed7c744-1b33-424e-9742-a7314209e2f6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lazy-loading 'fault' on Instance uuid 69fe618d-1192-4541-9d90-e5cee06be911 {{(pid=132076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 03:53:06.185756 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-0ed7c744-1b33-424e-9742-a7314209e2f6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:06.193474 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-0ed7c744-1b33-424e-9742-a7314209e2f6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911" status: 200 len: 1330 microversion: 2.1 time: 0.101374 Sep 03 03:53:06.194026 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 299/596] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:06 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 => generated 1330 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:06.271925 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-8d647cb4-b09b-49ab-885a-a865735befec tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:06.272492 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-8d647cb4-b09b-49ab-885a-a865735befec tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:06.279387 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8d647cb4-b09b-49ab-885a-a865735befec tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:06.279861 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8d647cb4-b09b-49ab-885a-a865735befec tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:06.280284 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8d647cb4-b09b-49ab-885a-a865735befec tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:06.280963 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8d647cb4-b09b-49ab-885a-a865735befec tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:06.281410 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8d647cb4-b09b-49ab-885a-a865735befec tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:06.281828 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8d647cb4-b09b-49ab-885a-a865735befec tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:06.421804 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-8d647cb4-b09b-49ab-885a-a865735befec tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:06.430227 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-8d647cb4-b09b-49ab-885a-a865735befec tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1736 microversion: 2.1 time: 0.162219 Sep 03 03:53:06.430722 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 298/597] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:06 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:06.700443 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-db7dee6e-6bc9-4b02-a2ce-7d458b8982af tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:06.701426 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-db7dee6e-6bc9-4b02-a2ce-7d458b8982af tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:06.711495 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-db7dee6e-6bc9-4b02-a2ce-7d458b8982af tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:06.712297 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-db7dee6e-6bc9-4b02-a2ce-7d458b8982af tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:06.713016 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-db7dee6e-6bc9-4b02-a2ce-7d458b8982af tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:06.714138 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-db7dee6e-6bc9-4b02-a2ce-7d458b8982af tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:06.715016 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-db7dee6e-6bc9-4b02-a2ce-7d458b8982af tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:06.715725 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-db7dee6e-6bc9-4b02-a2ce-7d458b8982af tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:06.774438 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-044bb866-6e56-463b-8949-323b1c75c57c tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:06.775460 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-044bb866-6e56-463b-8949-323b1c75c57c tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 4debbf95-0ffb-408e-bc62-12015a742cff] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:06.782296 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-044bb866-6e56-463b-8949-323b1c75c57c tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:06.783166 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-044bb866-6e56-463b-8949-323b1c75c57c tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:06.783607 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-044bb866-6e56-463b-8949-323b1c75c57c tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:06.784300 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-044bb866-6e56-463b-8949-323b1c75c57c tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:06.784743 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-044bb866-6e56-463b-8949-323b1c75c57c tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:06.785154 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-044bb866-6e56-463b-8949-323b1c75c57c tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:06.845016 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-db7dee6e-6bc9-4b02-a2ce-7d458b8982af tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:06.852845 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-db7dee6e-6bc9-4b02-a2ce-7d458b8982af tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1678 microversion: 2.1 time: 0.158894 Sep 03 03:53:06.853412 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 300/598] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:06 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:06.915574 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-044bb866-6e56-463b-8949-323b1c75c57c tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0647075204ba183fb1e5beb2c5930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bafae6685e248d2ac4fab672648e941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:06.926060 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-044bb866-6e56-463b-8949-323b1c75c57c tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "GET /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff" status: 200 len: 1513 microversion: 2.1 time: 0.155601 Sep 03 03:53:06.926832 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 299/599] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:06 2022] GET /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:07.221228 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-4dd82b58-db42-4926-83b1-aa851a03b12e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:07.223948 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-4dd82b58-db42-4926-83b1-aa851a03b12e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:07.233323 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4dd82b58-db42-4926-83b1-aa851a03b12e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:07.233940 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4dd82b58-db42-4926-83b1-aa851a03b12e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:07.234371 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4dd82b58-db42-4926-83b1-aa851a03b12e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:07.235234 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4dd82b58-db42-4926-83b1-aa851a03b12e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:07.235687 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4dd82b58-db42-4926-83b1-aa851a03b12e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:07.236094 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4dd82b58-db42-4926-83b1-aa851a03b12e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:07.268670 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4dd82b58-db42-4926-83b1-aa851a03b12e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:07.269145 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4dd82b58-db42-4926-83b1-aa851a03b12e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:07.269568 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4dd82b58-db42-4926-83b1-aa851a03b12e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:07.270000 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.objects.instance [None req-4dd82b58-db42-4926-83b1-aa851a03b12e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lazy-loading 'fault' on Instance uuid 69fe618d-1192-4541-9d90-e5cee06be911 {{(pid=132076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 03:53:07.314194 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-4dd82b58-db42-4926-83b1-aa851a03b12e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:07.327154 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-4dd82b58-db42-4926-83b1-aa851a03b12e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911" status: 200 len: 1330 microversion: 2.1 time: 0.112010 Sep 03 03:53:07.328077 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 301/600] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:07 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 => generated 1330 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:07.457812 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-accfb686-bc2d-48a8-ab98-8347e13b15dc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:07.458655 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-accfb686-bc2d-48a8-ab98-8347e13b15dc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:07.468089 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-accfb686-bc2d-48a8-ab98-8347e13b15dc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:07.468572 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-accfb686-bc2d-48a8-ab98-8347e13b15dc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:07.468998 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-accfb686-bc2d-48a8-ab98-8347e13b15dc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:07.469694 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-accfb686-bc2d-48a8-ab98-8347e13b15dc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:07.470133 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-accfb686-bc2d-48a8-ab98-8347e13b15dc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:07.470560 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-accfb686-bc2d-48a8-ab98-8347e13b15dc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:07.600876 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-accfb686-bc2d-48a8-ab98-8347e13b15dc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:07.610232 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-accfb686-bc2d-48a8-ab98-8347e13b15dc tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1736 microversion: 2.1 time: 0.159037 Sep 03 03:53:07.610828 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 300/601] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:07 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:07.879947 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-ed9633b7-d62c-4afe-87e1-a63935f6f287 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:07.880630 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-ed9633b7-d62c-4afe-87e1-a63935f6f287 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:07.889660 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ed9633b7-d62c-4afe-87e1-a63935f6f287 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:07.890315 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ed9633b7-d62c-4afe-87e1-a63935f6f287 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:07.890748 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ed9633b7-d62c-4afe-87e1-a63935f6f287 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:07.891463 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ed9633b7-d62c-4afe-87e1-a63935f6f287 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:07.891906 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ed9633b7-d62c-4afe-87e1-a63935f6f287 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:07.892319 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ed9633b7-d62c-4afe-87e1-a63935f6f287 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:07.948898 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-efeaab6b-2d82-4717-b623-6cf736146b02 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:07.949606 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-efeaab6b-2d82-4717-b623-6cf736146b02 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 4debbf95-0ffb-408e-bc62-12015a742cff] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:07.956001 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-efeaab6b-2d82-4717-b623-6cf736146b02 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:07.956483 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-efeaab6b-2d82-4717-b623-6cf736146b02 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:07.956910 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-efeaab6b-2d82-4717-b623-6cf736146b02 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:07.957598 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-efeaab6b-2d82-4717-b623-6cf736146b02 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:07.958040 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-efeaab6b-2d82-4717-b623-6cf736146b02 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:07.958517 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-efeaab6b-2d82-4717-b623-6cf736146b02 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:08.026357 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-ed9633b7-d62c-4afe-87e1-a63935f6f287 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:08.034035 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-ed9633b7-d62c-4afe-87e1-a63935f6f287 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1678 microversion: 2.1 time: 0.160577 Sep 03 03:53:08.034846 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 302/602] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:07 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:08.086661 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-efeaab6b-2d82-4717-b623-6cf736146b02 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0647075204ba183fb1e5beb2c5930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bafae6685e248d2ac4fab672648e941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:08.094508 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-efeaab6b-2d82-4717-b623-6cf736146b02 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "GET /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff" status: 200 len: 1513 microversion: 2.1 time: 0.149482 Sep 03 03:53:08.095110 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 301/603] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:07 2022] GET /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:08.359114 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-87824cc8-2e6c-4e2f-8ad1-37a8ac8b3efd tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:08.360145 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-87824cc8-2e6c-4e2f-8ad1-37a8ac8b3efd tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:08.370893 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-87824cc8-2e6c-4e2f-8ad1-37a8ac8b3efd tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:08.371736 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-87824cc8-2e6c-4e2f-8ad1-37a8ac8b3efd tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:08.372407 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-87824cc8-2e6c-4e2f-8ad1-37a8ac8b3efd tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:08.373102 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-87824cc8-2e6c-4e2f-8ad1-37a8ac8b3efd tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:08.373550 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-87824cc8-2e6c-4e2f-8ad1-37a8ac8b3efd tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:08.373970 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-87824cc8-2e6c-4e2f-8ad1-37a8ac8b3efd tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:08.387597 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.wsgi [None req-87824cc8-2e6c-4e2f-8ad1-37a8ac8b3efd tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] HTTP exception thrown: Instance 69fe618d-1192-4541-9d90-e5cee06be911 could not be found. Sep 03 03:53:08.389230 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-87824cc8-2e6c-4e2f-8ad1-37a8ac8b3efd tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Request method failure captured: Sep 03 03:53:08.389230 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: request: GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 HTTP/1.1 Sep 03 03:53:08.389230 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept: application/json Sep 03 03:53:08.389230 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept-Encoding: identity Sep 03 03:53:08.389230 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Connection: close Sep 03 03:53:08.389230 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Length: 0 Sep 03 03:53:08.389230 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Type: application/json Sep 03 03:53:08.389230 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Host: 10.222.0.25 Sep 03 03:53:08.389230 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Openstack-System-Scope: None Sep 03 03:53:08.389230 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: User-Agent: python-urllib3/1.26.12 Sep 03 03:53:08.389230 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Auth-Token: gAAAAABjEs650LfhdeTARTcps2T6trtQQt2m5icunzzvIWer-eUYgJYZG5Pjv6m6uWkZdMglMW7-SwnvvwA9dyIFe0GhqjthXj4rFLg5_wGV22DwN7Tu1nE8T--OP86NZDND7AUMPsZwRHed6vQjd_qeShmm1sU59yMmrfP4r0ItLtiNkEQOrd0 Sep 03 03:53:08.389230 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Id: None Sep 03 03:53:08.389230 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Name: None Sep 03 03:53:08.389230 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Identity-Status: Confirmed Sep 03 03:53:08.389230 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Is-Admin-Project: True Sep 03 03:53:08.389230 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Id: default Sep 03 03:53:08.389230 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Name: Default Sep 03 03:53:08.389230 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Id: ac9e77355ba040bda4f2186753df7b24 Sep 03 03:53:08.389230 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Name: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:53:08.389230 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Role: member,reader Sep 03 03:53:08.389230 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Roles: member,reader Sep 03 03:53:08.390738 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:53:08.390738 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:53:08.390738 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Id: ac9e77355ba040bda4f2186753df7b24 Sep 03 03:53:08.390738 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:53:08.390738 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User: tempest-AttachVolumeNegativeTest-1116033749-project Sep 03 03:53:08.390738 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Id: default Sep 03 03:53:08.390738 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Name: Default Sep 03 03:53:08.390738 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Id: 1dde7fad075145c89f726ca85c6c00ba Sep 03 03:53:08.390738 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Name: tempest-AttachVolumeNegativeTest-1116033749-project Sep 03 03:53:08.390738 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: method: > Sep 03 03:53:08.390738 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: exception: Instance 69fe618d-1192-4541-9d90-e5cee06be911 could not be found. Sep 03 03:53:08.390738 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: action_args: {'id': '69fe618d-1192-4541-9d90-e5cee06be911'} Sep 03 03:53:08.391668 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:53:08.391668 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:53:08.391668 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 03:53:08.391668 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 03:53:08.391668 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 03:53:08.391668 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 03:53:08.391668 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 03:53:08.391668 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 03:53:08.391668 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 03:53:08.391668 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 03:53:08.391668 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69fe618d-1192-4541-9d90-e5cee06be911 could not be found. Sep 03 03:53:08.391668 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:53:08.391668 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:53:08.391668 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:53:08.391668 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:53:08.391668 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:53:08.391668 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:53:08.391668 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:53:08.391668 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:53:08.391668 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:53:08.393072 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:53:08.393072 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 03:53:08.393072 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 03:53:08.393072 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 03:53:08.393072 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 03:53:08.393072 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 03:53:08.393072 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:53:08.393072 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69fe618d-1192-4541-9d90-e5cee06be911 could not be found. Sep 03 03:53:08.393072 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:53:08.393072 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:53:08.393072 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:53:08.393072 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:53:08.393072 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:53:08.393072 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:53:08.393072 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:53:08.393072 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:53:08.393072 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69fe618d-1192-4541-9d90-e5cee06be911 could not be found. Sep 03 03:53:08.393072 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:53:08.394402 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-87824cc8-2e6c-4e2f-8ad1-37a8ac8b3efd tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Returning 404 to user: Instance 69fe618d-1192-4541-9d90-e5cee06be911 could not be found. {{(pid=132076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:53:08.394402 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-87824cc8-2e6c-4e2f-8ad1-37a8ac8b3efd tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911" status: 404 len: 111 microversion: 2.1 time: 0.038344 Sep 03 03:53:08.394402 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 303/604] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:08 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 03:53:08.399471 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-54d0f3f4-1316-4bb6-8031-5d5f205177ba tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '.version_select at 0x7f45fc5a4c10>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:08.422283 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-54d0f3f4-1316-4bb6-8031-5d5f205177ba tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-858437405" status: 202 len: 0 microversion: 2.1 time: 0.026526 Sep 03 03:53:08.422834 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 302/605] 10.222.0.25 () {58 vars in 1218 bytes} [Sat Sep 3 03:53:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-858437405 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 03:53:08.633855 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-1f1edf89-55bb-4a57-9272-9580f89a89ae tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:08.634563 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-1f1edf89-55bb-4a57-9272-9580f89a89ae tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:08.640980 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1f1edf89-55bb-4a57-9272-9580f89a89ae tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:08.641545 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1f1edf89-55bb-4a57-9272-9580f89a89ae tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:08.642044 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1f1edf89-55bb-4a57-9272-9580f89a89ae tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:08.642904 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1f1edf89-55bb-4a57-9272-9580f89a89ae tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:08.643420 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1f1edf89-55bb-4a57-9272-9580f89a89ae tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:08.644072 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1f1edf89-55bb-4a57-9272-9580f89a89ae tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:09.032174 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-1f1edf89-55bb-4a57-9272-9580f89a89ae tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:09.040487 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-1f1edf89-55bb-4a57-9272-9580f89a89ae tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1736 microversion: 2.1 time: 0.410609 Sep 03 03:53:09.041074 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 304/606] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:08 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1736 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:09.057804 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-2bf40d01-e6bb-4a29-8a54-796dc2fb7b7b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:09.058460 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-2bf40d01-e6bb-4a29-8a54-796dc2fb7b7b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:09.068011 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2bf40d01-e6bb-4a29-8a54-796dc2fb7b7b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:09.068479 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2bf40d01-e6bb-4a29-8a54-796dc2fb7b7b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:09.068930 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2bf40d01-e6bb-4a29-8a54-796dc2fb7b7b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:09.069694 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2bf40d01-e6bb-4a29-8a54-796dc2fb7b7b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:09.070077 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2bf40d01-e6bb-4a29-8a54-796dc2fb7b7b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:09.070494 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2bf40d01-e6bb-4a29-8a54-796dc2fb7b7b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:09.127460 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-17ddf3f8-f834-4f4e-93bd-ba3fb8a56d87 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:09.128408 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-17ddf3f8-f834-4f4e-93bd-ba3fb8a56d87 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 4debbf95-0ffb-408e-bc62-12015a742cff] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:09.134741 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-17ddf3f8-f834-4f4e-93bd-ba3fb8a56d87 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:09.135286 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-17ddf3f8-f834-4f4e-93bd-ba3fb8a56d87 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:09.135685 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-17ddf3f8-f834-4f4e-93bd-ba3fb8a56d87 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:09.136629 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-17ddf3f8-f834-4f4e-93bd-ba3fb8a56d87 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:09.137293 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-17ddf3f8-f834-4f4e-93bd-ba3fb8a56d87 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:09.137905 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-17ddf3f8-f834-4f4e-93bd-ba3fb8a56d87 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:09.207379 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-2bf40d01-e6bb-4a29-8a54-796dc2fb7b7b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:09.215801 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-2bf40d01-e6bb-4a29-8a54-796dc2fb7b7b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1678 microversion: 2.1 time: 0.162081 Sep 03 03:53:09.216489 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 303/607] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:09 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:09.419697 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-17ddf3f8-f834-4f4e-93bd-ba3fb8a56d87 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0647075204ba183fb1e5beb2c5930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bafae6685e248d2ac4fab672648e941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:09.427611 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-17ddf3f8-f834-4f4e-93bd-ba3fb8a56d87 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "GET /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff" status: 200 len: 1513 microversion: 2.1 time: 0.304440 Sep 03 03:53:09.428408 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 305/608] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:09 2022] GET /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff => generated 1513 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:09.648883 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-8080dc7e-f548-44bb-9ea6-005aec3d581b tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Action: 'create', calling method: .version_select at 0x7f45fca85a60>, body: {"keypair": {"name": "tempest-keypair-1889348533", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNc5B2we5yJ6aebUZYTc+cALN0qkif9/27OHu7pTjiaFkX8Ew30yvWuzi5oSuDB/8nf+iDfOg/rofDWMhOOPo5q6c3sYy3k5q1c6NZ76vBjF1I193qpOhYnd1yJjsPtMqg=="}} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:53:09.664462 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.quota [None req-8080dc7e-f548-44bb-9ea6-005aec3d581b tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Getting quotas for project ac9e77355ba040bda4f2186753df7b24. Resources: {'key_pairs'} {{(pid=132077) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 03:53:09.668549 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.quota [None req-8080dc7e-f548-44bb-9ea6-005aec3d581b tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Getting quotas for user 1dde7fad075145c89f726ca85c6c00ba and project ac9e77355ba040bda4f2186753df7b24. Resources: {'key_pairs'} {{(pid=132077) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 03:53:09.689376 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-b016a433-f18d-4a89-a853-261e6660dc6d req-e3d99157-87ee-4a70-a15f-abb9bf533ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4debbf95-0ffb-408e-bc62-12015a742cff", "name": "network-vif-deleted", "tag": "c369599b-8063-4d16-b7ee-03c9e0bbb2e5"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:53:09.691376 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-8080dc7e-f548-44bb-9ea6-005aec3d581b tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048558 Sep 03 03:53:09.691977 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 304/609] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Sep 3 03:53:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 03:53:09.699568 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-b016a433-f18d-4a89-a853-261e6660dc6d req-e3d99157-87ee-4a70-a15f-abb9bf533ae1 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:09.700039 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-b016a433-f18d-4a89-a853-261e6660dc6d req-e3d99157-87ee-4a70-a15f-abb9bf533ae1 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:09.700514 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-b016a433-f18d-4a89-a853-261e6660dc6d req-e3d99157-87ee-4a70-a15f-abb9bf533ae1 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:09.713383 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-b016a433-f18d-4a89-a853-261e6660dc6d req-e3d99157-87ee-4a70-a15f-abb9bf533ae1 service nova] Creating event network-vif-deleted:c369599b-8063-4d16-b7ee-03c9e0bbb2e5 for instance 4debbf95-0ffb-408e-bc62-12015a742cff on hv-cinder-79966 Sep 03 03:53:09.718640 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-b016a433-f18d-4a89-a853-261e6660dc6d req-e3d99157-87ee-4a70-a15f-abb9bf533ae1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033186 Sep 03 03:53:09.719290 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 306/610] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 03:53:10.065819 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-d3714801-7418-4160-8bc1-a32cd50619b9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:10.066422 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-d3714801-7418-4160-8bc1-a32cd50619b9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:10.072830 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d3714801-7418-4160-8bc1-a32cd50619b9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:10.073349 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d3714801-7418-4160-8bc1-a32cd50619b9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:10.074007 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d3714801-7418-4160-8bc1-a32cd50619b9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:10.074690 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d3714801-7418-4160-8bc1-a32cd50619b9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:10.075186 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d3714801-7418-4160-8bc1-a32cd50619b9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:10.075625 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d3714801-7418-4160-8bc1-a32cd50619b9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:10.215358 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-d3714801-7418-4160-8bc1-a32cd50619b9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:10.223968 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-d3714801-7418-4160-8bc1-a32cd50619b9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1736 microversion: 2.1 time: 0.162816 Sep 03 03:53:10.224773 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 305/611] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:10 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:10.241110 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-34337040-fbd0-4919-90c0-531f15ee793e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:10.241787 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-34337040-fbd0-4919-90c0-531f15ee793e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:10.248677 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-34337040-fbd0-4919-90c0-531f15ee793e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:10.249155 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-34337040-fbd0-4919-90c0-531f15ee793e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:10.249578 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-34337040-fbd0-4919-90c0-531f15ee793e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:10.250267 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-34337040-fbd0-4919-90c0-531f15ee793e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:10.250704 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-34337040-fbd0-4919-90c0-531f15ee793e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:10.251144 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-34337040-fbd0-4919-90c0-531f15ee793e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:10.451750 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-9968dfbf-5ae9-4632-9176-380ca366edd9 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:10.452519 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-9968dfbf-5ae9-4632-9176-380ca366edd9 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 4debbf95-0ffb-408e-bc62-12015a742cff] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:10.455902 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-34337040-fbd0-4919-90c0-531f15ee793e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:10.458572 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9968dfbf-5ae9-4632-9176-380ca366edd9 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:10.459352 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9968dfbf-5ae9-4632-9176-380ca366edd9 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:10.459998 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9968dfbf-5ae9-4632-9176-380ca366edd9 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:10.460690 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9968dfbf-5ae9-4632-9176-380ca366edd9 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:10.461135 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9968dfbf-5ae9-4632-9176-380ca366edd9 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:10.461553 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9968dfbf-5ae9-4632-9176-380ca366edd9 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:10.464613 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-34337040-fbd0-4919-90c0-531f15ee793e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1678 microversion: 2.1 time: 0.227581 Sep 03 03:53:10.465188 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 307/612] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:10 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1678 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:10.494533 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9968dfbf-5ae9-4632-9176-380ca366edd9 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:10.495698 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9968dfbf-5ae9-4632-9176-380ca366edd9 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:10.496129 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9968dfbf-5ae9-4632-9176-380ca366edd9 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:10.496570 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.objects.instance [None req-9968dfbf-5ae9-4632-9176-380ca366edd9 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lazy-loading 'fault' on Instance uuid 4debbf95-0ffb-408e-bc62-12015a742cff {{(pid=132077) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 03:53:10.536348 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-9968dfbf-5ae9-4632-9176-380ca366edd9 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f0647075204ba183fb1e5beb2c5930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bafae6685e248d2ac4fab672648e941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:10.544743 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-9968dfbf-5ae9-4632-9176-380ca366edd9 tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "GET /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff" status: 200 len: 1309 microversion: 2.1 time: 0.096837 Sep 03 03:53:10.558828 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 306/613] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:10 2022] GET /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff => generated 1309 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:11.135883 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-acc3e417-7625-482c-8928-567a27cb1332 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1197575143", "imageRef": "0af209bb-870a-4343-a9f9-de05883bb8dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3310a324-39c6-4074-b839-e8b47e45dc07"}], "security_groups": [{"name": "tempest-securitygroup--1598025075"}], "key_name": "tempest-keypair-1889348533", "user_data": "}} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:53:11.242986 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.network.neutron [None req-acc3e417-7625-482c-8928-567a27cb1332 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] validate_networks() for [('3310a324-39c6-4074-b839-e8b47e45dc07', None, None, None, None, None)] {{(pid=132076) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 03:53:11.248481 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-e1719904-b651-4dec-a49e-cf358dc9b432 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:11.249076 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-e1719904-b651-4dec-a49e-cf358dc9b432 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:11.257400 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e1719904-b651-4dec-a49e-cf358dc9b432 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:11.258285 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e1719904-b651-4dec-a49e-cf358dc9b432 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:11.258908 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e1719904-b651-4dec-a49e-cf358dc9b432 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:11.259769 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e1719904-b651-4dec-a49e-cf358dc9b432 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:11.260364 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e1719904-b651-4dec-a49e-cf358dc9b432 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:11.260947 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e1719904-b651-4dec-a49e-cf358dc9b432 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:11.394204 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-e1719904-b651-4dec-a49e-cf358dc9b432 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:11.402690 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-e1719904-b651-4dec-a49e-cf358dc9b432 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1716 microversion: 2.1 time: 0.158060 Sep 03 03:53:11.405395 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 307/614] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:11 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1716 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:53:11.489326 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-407794cf-c6b3-45a5-be03-60d8bec879d8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:11.489918 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-407794cf-c6b3-45a5-be03-60d8bec879d8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:11.496695 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-407794cf-c6b3-45a5-be03-60d8bec879d8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:11.497173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-407794cf-c6b3-45a5-be03-60d8bec879d8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:11.497801 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-407794cf-c6b3-45a5-be03-60d8bec879d8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:11.498652 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-407794cf-c6b3-45a5-be03-60d8bec879d8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:11.499119 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-407794cf-c6b3-45a5-be03-60d8bec879d8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:11.499750 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-407794cf-c6b3-45a5-be03-60d8bec879d8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:11.626313 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-acc3e417-7625-482c-8928-567a27cb1332 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Flavor limits 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 03:53:11.626851 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-acc3e417-7625-482c-8928-567a27cb1332 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Image limits 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 03:53:11.627211 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-acc3e417-7625-482c-8928-567a27cb1332 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Flavor pref 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 03:53:11.627641 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-acc3e417-7625-482c-8928-567a27cb1332 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Image pref 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 03:53:11.628044 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-acc3e417-7625-482c-8928-567a27cb1332 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 03:53:11.636959 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-acc3e417-7625-482c-8928-567a27cb1332 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:11.637440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-acc3e417-7625-482c-8928-567a27cb1332 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:11.637954 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-acc3e417-7625-482c-8928-567a27cb1332 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:11.638675 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-acc3e417-7625-482c-8928-567a27cb1332 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:11.639155 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-acc3e417-7625-482c-8928-567a27cb1332 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:11.639573 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-acc3e417-7625-482c-8928-567a27cb1332 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:11.641306 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-407794cf-c6b3-45a5-be03-60d8bec879d8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:11.649382 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-407794cf-c6b3-45a5-be03-60d8bec879d8 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1678 microversion: 2.1 time: 0.165075 Sep 03 03:53:11.650157 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 308/615] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:11 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:53:11.655005 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-15ad98ae-1b08-46b6-a355-9245f3d91879 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:11.655482 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-15ad98ae-1b08-46b6-a355-9245f3d91879 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:11.661356 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-15ad98ae-1b08-46b6-a355-9245f3d91879 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:11.661823 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-15ad98ae-1b08-46b6-a355-9245f3d91879 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:11.662247 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-15ad98ae-1b08-46b6-a355-9245f3d91879 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:11.662922 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-15ad98ae-1b08-46b6-a355-9245f3d91879 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:11.663398 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-15ad98ae-1b08-46b6-a355-9245f3d91879 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:11.663809 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-15ad98ae-1b08-46b6-a355-9245f3d91879 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:11.671395 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.quota [None req-acc3e417-7625-482c-8928-567a27cb1332 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Getting quotas for project ac9e77355ba040bda4f2186753df7b24. Resources: {'ram', 'instances', 'cores'} {{(pid=132076) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 03:53:11.679717 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.quota [None req-acc3e417-7625-482c-8928-567a27cb1332 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Getting quotas for user 1dde7fad075145c89f726ca85c6c00ba and project ac9e77355ba040bda4f2186753df7b24. Resources: {'ram', 'instances', 'cores'} {{(pid=132076) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 03:53:11.682095 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:53:11.698679 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-acc3e417-7625-482c-8928-567a27cb1332 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Going to run 1 instances... {{(pid=132076) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 03:53:11.700853 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-acc3e417-7625-482c-8928-567a27cb1332 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 8cbb99ff-b818-4de4-9dde-a3c27164f6af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0af209bb-870a-4343-a9f9-de05883bb8dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132076) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 03:53:11.745975 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.wsgi [None req-15ad98ae-1b08-46b6-a355-9245f3d91879 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] HTTP exception thrown: Cannot 'detach_volume' instance 4f5b827b-0905-4360-b0b5-f5881a029bc2 while it is in vm_state rescued Sep 03 03:53:11.746763 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-acc3e417-7625-482c-8928-567a27cb1332 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.615449 Sep 03 03:53:11.747429 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 308/616] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Sep 3 03:53:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 03:53:11.748110 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-15ad98ae-1b08-46b6-a355-9245f3d91879 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Request method failure captured: Sep 03 03:53:11.748110 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: request: DELETE /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2/os-volume_attachments/c1fc6664-e084-4952-b7af-ebe490548b8f HTTP/1.1 Sep 03 03:53:11.748110 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept: application/json Sep 03 03:53:11.748110 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept-Encoding: identity Sep 03 03:53:11.748110 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Connection: close Sep 03 03:53:11.748110 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Length: 0 Sep 03 03:53:11.748110 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Type: application/json Sep 03 03:53:11.748110 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Host: 10.222.0.25 Sep 03 03:53:11.748110 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Openstack-System-Scope: None Sep 03 03:53:11.748110 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: User-Agent: python-urllib3/1.26.12 Sep 03 03:53:11.748110 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Auth-Token: gAAAAABjEs66Kx8eeteMVyS4cMyfSkiyDGt_1eVtJar0jOqp2U5kldUKx2JCGXQO7DqE-XDheXtg2VZJo07feGC0TW1g6g8FkP9CZLuHpBInyfHfnQ4XyPTBmpEjfujwrAu0nW2aGLx5J777qnmGLgujnVhLN2AJ7Ilf6ZAuow1eLdAaB6k8vVw Sep 03 03:53:11.748110 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Id: None Sep 03 03:53:11.748110 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Name: None Sep 03 03:53:11.748110 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Identity-Status: Confirmed Sep 03 03:53:11.748110 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Is-Admin-Project: True Sep 03 03:53:11.748110 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Id: default Sep 03 03:53:11.748110 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Name: Default Sep 03 03:53:11.748110 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Id: f3077cfc588042e0a1becefe1363385c Sep 03 03:53:11.748110 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1521748712 Sep 03 03:53:11.748110 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Role: member,reader Sep 03 03:53:11.748110 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Roles: member,reader Sep 03 03:53:11.757307 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f3077cfc588042e0a1becefe1363385c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f3077cfc588042e0a1becefe1363385c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f3077cfc588042e0a1becefe1363385c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f3077cfc588042e0a1becefe1363385c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:53:11.757307 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1521748712 Sep 03 03:53:11.757307 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Id: f3077cfc588042e0a1becefe1363385c Sep 03 03:53:11.757307 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1521748712 Sep 03 03:53:11.757307 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User: tempest-ServerRescueNegativeTestJSON-1521748712-project Sep 03 03:53:11.757307 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Id: default Sep 03 03:53:11.757307 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Name: Default Sep 03 03:53:11.757307 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Id: ba00478a6ef74115b83726083026f574 Sep 03 03:53:11.757307 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1521748712-project Sep 03 03:53:11.757307 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: method: > Sep 03 03:53:11.757307 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: exception: Cannot 'detach_volume' instance 4f5b827b-0905-4360-b0b5-f5881a029bc2 while it is in vm_state rescued Sep 03 03:53:11.758067 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: action_args: {'server_id': '4f5b827b-0905-4360-b0b5-f5881a029bc2', 'id': 'c1fc6664-e084-4952-b7af-ebe490548b8f'} Sep 03 03:53:11.758067 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:53:11.758067 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:53:11.758067 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 03 03:53:11.758067 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 03 03:53:11.758067 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 03 03:53:11.758067 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 03 03:53:11.758067 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 03 03:53:11.758067 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 03 03:53:11.758067 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4f5b827b-0905-4360-b0b5-f5881a029bc2 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 03 03:53:11.758067 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:53:11.758067 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:53:11.758067 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:53:11.758067 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:53:11.758067 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:53:11.758067 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:53:11.758067 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:53:11.758067 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:53:11.758067 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:53:11.758067 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:53:11.759266 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 03 03:53:11.759266 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 03 03:53:11.759266 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 03 03:53:11.759266 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 03 03:53:11.759266 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4f5b827b-0905-4360-b0b5-f5881a029bc2 while it is in vm_state rescued Sep 03 03:53:11.759266 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:53:11.759266 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:53:11.759266 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:53:11.759266 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:53:11.759266 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:53:11.759266 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:53:11.759266 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:53:11.759266 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:53:11.759266 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4f5b827b-0905-4360-b0b5-f5881a029bc2 while it is in vm_state rescued Sep 03 03:53:11.759266 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:53:11.759266 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-15ad98ae-1b08-46b6-a355-9245f3d91879 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Returning 409 to user: Cannot 'detach_volume' instance 4f5b827b-0905-4360-b0b5-f5881a029bc2 while it is in vm_state rescued {{(pid=132077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:53:11.760187 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-15ad98ae-1b08-46b6-a355-9245f3d91879 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2/os-volume_attachments/c1fc6664-e084-4952-b7af-ebe490548b8f" status: 409 len: 152 microversion: 2.1 time: 0.099232 Sep 03 03:53:11.760187 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 309/617] 10.222.0.25 () {58 vars in 1416 bytes} [Sat Sep 3 03:53:11 2022] DELETE /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2/os-volume_attachments/c1fc6664-e084-4952-b7af-ebe490548b8f => generated 152 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 03 03:53:11.769902 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-1ba747e3-3ae5-400c-a92b-add6136c019f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:53:11.770348 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-1ba747e3-3ae5-400c-a92b-add6136c019f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:11.776051 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-89f007d4-a054-49ce-aff6-583fd622b2cd tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:11.776731 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-89f007d4-a054-49ce-aff6-583fd622b2cd tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] [instance: 4debbf95-0ffb-408e-bc62-12015a742cff] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:11.776896 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1ba747e3-3ae5-400c-a92b-add6136c019f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:11.777372 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1ba747e3-3ae5-400c-a92b-add6136c019f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:11.777949 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1ba747e3-3ae5-400c-a92b-add6136c019f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:11.778607 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1ba747e3-3ae5-400c-a92b-add6136c019f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:11.779122 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1ba747e3-3ae5-400c-a92b-add6136c019f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:11.779671 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1ba747e3-3ae5-400c-a92b-add6136c019f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:11.786485 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-89f007d4-a054-49ce-aff6-583fd622b2cd tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:11.787183 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-89f007d4-a054-49ce-aff6-583fd622b2cd tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:11.787622 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-89f007d4-a054-49ce-aff6-583fd622b2cd tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:11.788318 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-89f007d4-a054-49ce-aff6-583fd622b2cd tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:11.788769 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-89f007d4-a054-49ce-aff6-583fd622b2cd tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:11.789221 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-89f007d4-a054-49ce-aff6-583fd622b2cd tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:11.803302 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.wsgi [None req-89f007d4-a054-49ce-aff6-583fd622b2cd tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] HTTP exception thrown: Instance 4debbf95-0ffb-408e-bc62-12015a742cff could not be found. Sep 03 03:53:11.804999 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-89f007d4-a054-49ce-aff6-583fd622b2cd tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Request method failure captured: Sep 03 03:53:11.804999 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: request: GET /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff HTTP/1.1 Sep 03 03:53:11.804999 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept: application/json Sep 03 03:53:11.804999 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept-Encoding: identity Sep 03 03:53:11.804999 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Connection: close Sep 03 03:53:11.804999 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Length: 0 Sep 03 03:53:11.804999 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Type: application/json Sep 03 03:53:11.804999 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Host: 10.222.0.25 Sep 03 03:53:11.804999 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Openstack-System-Scope: None Sep 03 03:53:11.804999 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: User-Agent: python-urllib3/1.26.12 Sep 03 03:53:11.804999 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Auth-Token: gAAAAABjEs8hbDWav-6BAuZxYhUx8lLgsThpZdjEyVVZvwjvbSnyTWlUsvQTr76vsg5WwId-bBDh_fTkHJVDP4Yj6SDe7MhedV5tsLweSsGFbU3PePOYHw4tDQtfl69uLA8HhGgUpmysYePJWaP7uReNdRuy98PzoQU4UlBV38gGpq12kVQ5PVc Sep 03 03:53:11.804999 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Id: None Sep 03 03:53:11.804999 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Name: None Sep 03 03:53:11.804999 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Identity-Status: Confirmed Sep 03 03:53:11.804999 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Is-Admin-Project: True Sep 03 03:53:11.804999 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Id: default Sep 03 03:53:11.804999 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Name: Default Sep 03 03:53:11.804999 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Id: 6bafae6685e248d2ac4fab672648e941 Sep 03 03:53:11.804999 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1874783988 Sep 03 03:53:11.804999 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Role: member,reader Sep 03 03:53:11.804999 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Roles: member,reader Sep 03 03:53:11.806402 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6bafae6685e248d2ac4fab672648e941"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6bafae6685e248d2ac4fab672648e941"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6bafae6685e248d2ac4fab672648e941"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6bafae6685e248d2ac4fab672648e941"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:53:11.806402 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant: tempest-VolumesSnapshotTestJSON-1874783988 Sep 03 03:53:11.806402 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Id: 6bafae6685e248d2ac4fab672648e941 Sep 03 03:53:11.806402 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1874783988 Sep 03 03:53:11.806402 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User: tempest-VolumesSnapshotTestJSON-1874783988-project Sep 03 03:53:11.806402 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Id: default Sep 03 03:53:11.806402 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Name: Default Sep 03 03:53:11.806402 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Id: 09f0647075204ba183fb1e5beb2c5930 Sep 03 03:53:11.806402 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Name: tempest-VolumesSnapshotTestJSON-1874783988-project Sep 03 03:53:11.806402 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: method: > Sep 03 03:53:11.806402 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: exception: Instance 4debbf95-0ffb-408e-bc62-12015a742cff could not be found. Sep 03 03:53:11.806402 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: action_args: {'id': '4debbf95-0ffb-408e-bc62-12015a742cff'} Sep 03 03:53:11.807242 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:53:11.807242 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:53:11.807242 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 03:53:11.807242 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 03:53:11.807242 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 03:53:11.807242 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 03:53:11.807242 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 03:53:11.807242 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 03:53:11.807242 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 03:53:11.807242 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 03:53:11.807242 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4debbf95-0ffb-408e-bc62-12015a742cff could not be found. Sep 03 03:53:11.807242 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:53:11.807242 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:53:11.807242 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:53:11.807242 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:53:11.807242 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:53:11.807242 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:53:11.807242 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:53:11.807242 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:53:11.807242 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:53:11.808394 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:53:11.808394 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 03:53:11.808394 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 03:53:11.808394 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 03:53:11.808394 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 03:53:11.808394 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 03:53:11.808394 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:53:11.808394 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4debbf95-0ffb-408e-bc62-12015a742cff could not be found. Sep 03 03:53:11.808394 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:53:11.808394 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:53:11.808394 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:53:11.808394 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:53:11.808394 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:53:11.808394 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:53:11.808394 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:53:11.808394 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:53:11.808394 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4debbf95-0ffb-408e-bc62-12015a742cff could not be found. Sep 03 03:53:11.808394 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:53:11.809409 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-89f007d4-a054-49ce-aff6-583fd622b2cd tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] Returning 404 to user: Instance 4debbf95-0ffb-408e-bc62-12015a742cff could not be found. {{(pid=132076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:53:11.809409 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-89f007d4-a054-49ce-aff6-583fd622b2cd tempest-VolumesSnapshotTestJSON-1874783988 tempest-VolumesSnapshotTestJSON-1874783988-project] 10.222.0.25 "GET /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff" status: 404 len: 111 microversion: 2.1 time: 0.038732 Sep 03 03:53:11.810678 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 309/618] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:11 2022] GET /compute/v2.1/servers/4debbf95-0ffb-408e-bc62-12015a742cff => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 03:53:11.817723 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-2c42285d-6b7f-4915-bb8f-bd41ccee93ee tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:11.817723 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-2c42285d-6b7f-4915-bb8f-bd41ccee93ee tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 8cbb99ff-b818-4de4-9dde-a3c27164f6af] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:11.863944 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-1ba747e3-3ae5-400c-a92b-add6136c019f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "POST /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2/action" status: 202 len: 0 microversion: 2.1 time: 0.097541 Sep 03 03:53:11.864926 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 310/619] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Sep 3 03:53:11 2022] POST /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 03:53:11.870661 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-2c42285d-6b7f-4915-bb8f-bd41ccee93ee tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:11.877957 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-2c42285d-6b7f-4915-bb8f-bd41ccee93ee tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af" status: 200 len: 1242 microversion: 2.1 time: 0.066809 Sep 03 03:53:11.891007 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 310/620] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:11 2022] GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:11.891738 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-b06adc16-5749-47f2-9688-341276cb43e5 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:11.891738 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-b06adc16-5749-47f2-9688-341276cb43e5 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:11.894009 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b06adc16-5749-47f2-9688-341276cb43e5 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:11.895095 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b06adc16-5749-47f2-9688-341276cb43e5 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:11.895570 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b06adc16-5749-47f2-9688-341276cb43e5 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:11.896684 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b06adc16-5749-47f2-9688-341276cb43e5 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:11.897187 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b06adc16-5749-47f2-9688-341276cb43e5 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:11.897710 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b06adc16-5749-47f2-9688-341276cb43e5 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:12.105066 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-b06adc16-5749-47f2-9688-341276cb43e5 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:12.116684 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-b06adc16-5749-47f2-9688-341276cb43e5 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1724 microversion: 2.1 time: 0.238219 Sep 03 03:53:12.129000 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 311/621] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:11 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:12.674369 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-1c80a2bb-b035-40ce-9481-e08b5e06edb5 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:12.674956 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-1c80a2bb-b035-40ce-9481-e08b5e06edb5 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:12.682374 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1c80a2bb-b035-40ce-9481-e08b5e06edb5 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:12.682872 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1c80a2bb-b035-40ce-9481-e08b5e06edb5 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:12.683404 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1c80a2bb-b035-40ce-9481-e08b5e06edb5 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:12.684148 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1c80a2bb-b035-40ce-9481-e08b5e06edb5 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:12.684719 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1c80a2bb-b035-40ce-9481-e08b5e06edb5 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:12.685138 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1c80a2bb-b035-40ce-9481-e08b5e06edb5 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:12.816349 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-1c80a2bb-b035-40ce-9481-e08b5e06edb5 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:12.824128 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-1c80a2bb-b035-40ce-9481-e08b5e06edb5 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1678 microversion: 2.1 time: 0.153973 Sep 03 03:53:12.824681 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 311/622] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:12 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:12.907061 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-e5b11e81-eb6d-4cb4-af5d-1c569d4ae9dc tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:12.907758 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-e5b11e81-eb6d-4cb4-af5d-1c569d4ae9dc tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 8cbb99ff-b818-4de4-9dde-a3c27164f6af] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:12.916502 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e5b11e81-eb6d-4cb4-af5d-1c569d4ae9dc tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:12.917142 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e5b11e81-eb6d-4cb4-af5d-1c569d4ae9dc tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:12.917717 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e5b11e81-eb6d-4cb4-af5d-1c569d4ae9dc tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:12.918672 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e5b11e81-eb6d-4cb4-af5d-1c569d4ae9dc tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:12.919352 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e5b11e81-eb6d-4cb4-af5d-1c569d4ae9dc tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:12.919773 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e5b11e81-eb6d-4cb4-af5d-1c569d4ae9dc tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:12.923905 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:53:12.993669 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-e5b11e81-eb6d-4cb4-af5d-1c569d4ae9dc tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:13.001457 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-e5b11e81-eb6d-4cb4-af5d-1c569d4ae9dc tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af" status: 200 len: 1294 microversion: 2.1 time: 0.100247 Sep 03 03:53:13.002028 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 312/623] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:12 2022] GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af => generated 1294 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:13.144789 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-0a6227c0-0cfe-457d-99d4-7601aeaf828c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:13.145935 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-0a6227c0-0cfe-457d-99d4-7601aeaf828c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:13.156011 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0a6227c0-0cfe-457d-99d4-7601aeaf828c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:13.156800 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0a6227c0-0cfe-457d-99d4-7601aeaf828c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:13.157606 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0a6227c0-0cfe-457d-99d4-7601aeaf828c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:13.158586 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0a6227c0-0cfe-457d-99d4-7601aeaf828c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:13.159404 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0a6227c0-0cfe-457d-99d4-7601aeaf828c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:13.160847 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0a6227c0-0cfe-457d-99d4-7601aeaf828c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:13.300256 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-0a6227c0-0cfe-457d-99d4-7601aeaf828c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:13.308645 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-0a6227c0-0cfe-457d-99d4-7601aeaf828c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1724 microversion: 2.1 time: 0.170208 Sep 03 03:53:13.309187 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 312/624] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:13 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:13.851833 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-69f3c744-a8c0-44af-aea9-d1db60ff3400 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:13.852841 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-69f3c744-a8c0-44af-aea9-d1db60ff3400 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:13.861077 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-69f3c744-a8c0-44af-aea9-d1db60ff3400 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:13.861565 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-69f3c744-a8c0-44af-aea9-d1db60ff3400 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:13.861994 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-69f3c744-a8c0-44af-aea9-d1db60ff3400 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:13.862690 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-69f3c744-a8c0-44af-aea9-d1db60ff3400 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:13.863186 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-69f3c744-a8c0-44af-aea9-d1db60ff3400 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:13.863606 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-69f3c744-a8c0-44af-aea9-d1db60ff3400 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:14.006382 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-69f3c744-a8c0-44af-aea9-d1db60ff3400 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:14.016638 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-69f3c744-a8c0-44af-aea9-d1db60ff3400 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1678 microversion: 2.1 time: 0.171315 Sep 03 03:53:14.017183 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 313/625] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:13 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:14.023936 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-3a038f88-7541-4875-96db-4acd421afb95 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:14.024511 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-3a038f88-7541-4875-96db-4acd421afb95 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 8cbb99ff-b818-4de4-9dde-a3c27164f6af] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:14.031484 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3a038f88-7541-4875-96db-4acd421afb95 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:14.031960 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3a038f88-7541-4875-96db-4acd421afb95 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:14.032388 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3a038f88-7541-4875-96db-4acd421afb95 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:14.033068 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3a038f88-7541-4875-96db-4acd421afb95 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:14.033506 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3a038f88-7541-4875-96db-4acd421afb95 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:14.033920 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3a038f88-7541-4875-96db-4acd421afb95 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:14.109814 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-3a038f88-7541-4875-96db-4acd421afb95 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:14.118732 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-3a038f88-7541-4875-96db-4acd421afb95 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af" status: 200 len: 1294 microversion: 2.1 time: 0.098535 Sep 03 03:53:14.119369 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 313/626] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:14 2022] GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af => generated 1294 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:53:14.336147 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-efa0c42d-741b-412c-a79f-b0f8364d97e6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:14.337135 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-efa0c42d-741b-412c-a79f-b0f8364d97e6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:14.344971 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-efa0c42d-741b-412c-a79f-b0f8364d97e6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:14.345448 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-efa0c42d-741b-412c-a79f-b0f8364d97e6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:14.345879 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-efa0c42d-741b-412c-a79f-b0f8364d97e6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:14.346569 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-efa0c42d-741b-412c-a79f-b0f8364d97e6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:14.347062 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-efa0c42d-741b-412c-a79f-b0f8364d97e6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:14.347485 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-efa0c42d-741b-412c-a79f-b0f8364d97e6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:14.492545 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-efa0c42d-741b-412c-a79f-b0f8364d97e6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:14.500974 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-efa0c42d-741b-412c-a79f-b0f8364d97e6 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1724 microversion: 2.1 time: 0.171484 Sep 03 03:53:14.501558 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 314/627] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:14 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:15.044337 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-18df09ee-d51f-4181-8785-80c95dbaefc1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:15.045255 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-18df09ee-d51f-4181-8785-80c95dbaefc1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:15.056313 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-18df09ee-d51f-4181-8785-80c95dbaefc1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:15.057118 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-18df09ee-d51f-4181-8785-80c95dbaefc1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:15.057836 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-18df09ee-d51f-4181-8785-80c95dbaefc1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:15.059021 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-18df09ee-d51f-4181-8785-80c95dbaefc1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:15.059827 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-18df09ee-d51f-4181-8785-80c95dbaefc1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:15.060245 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-18df09ee-d51f-4181-8785-80c95dbaefc1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:15.141850 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-5968bb66-bf49-484f-a6a3-49a7f6125757 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:15.142786 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-5968bb66-bf49-484f-a6a3-49a7f6125757 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 8cbb99ff-b818-4de4-9dde-a3c27164f6af] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:15.151208 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5968bb66-bf49-484f-a6a3-49a7f6125757 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:15.151698 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5968bb66-bf49-484f-a6a3-49a7f6125757 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:15.152125 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5968bb66-bf49-484f-a6a3-49a7f6125757 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:15.152824 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5968bb66-bf49-484f-a6a3-49a7f6125757 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:15.153363 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5968bb66-bf49-484f-a6a3-49a7f6125757 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:15.153786 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5968bb66-bf49-484f-a6a3-49a7f6125757 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:15.193819 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-18df09ee-d51f-4181-8785-80c95dbaefc1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:15.202191 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-18df09ee-d51f-4181-8785-80c95dbaefc1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1678 microversion: 2.1 time: 0.164275 Sep 03 03:53:15.203322 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 314/628] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:15 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:15.220554 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-5968bb66-bf49-484f-a6a3-49a7f6125757 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:15.230987 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-5968bb66-bf49-484f-a6a3-49a7f6125757 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af" status: 200 len: 1294 microversion: 2.1 time: 0.093103 Sep 03 03:53:15.231557 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 315/629] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:15 2022] GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af => generated 1294 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:15.524110 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-7503b32b-58ac-47b9-b1f8-7a1edabf461e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:15.524708 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-7503b32b-58ac-47b9-b1f8-7a1edabf461e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:15.531159 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7503b32b-58ac-47b9-b1f8-7a1edabf461e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:15.531640 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7503b32b-58ac-47b9-b1f8-7a1edabf461e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:15.532072 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7503b32b-58ac-47b9-b1f8-7a1edabf461e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:15.532759 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7503b32b-58ac-47b9-b1f8-7a1edabf461e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:15.533200 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7503b32b-58ac-47b9-b1f8-7a1edabf461e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:15.533618 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7503b32b-58ac-47b9-b1f8-7a1edabf461e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:15.669124 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-7503b32b-58ac-47b9-b1f8-7a1edabf461e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:15.681760 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-7503b32b-58ac-47b9-b1f8-7a1edabf461e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1724 microversion: 2.1 time: 0.161150 Sep 03 03:53:15.682487 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 315/630] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:15 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:16.227659 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-298d9818-1301-40ef-baa6-372eee86c89f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:16.228437 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-298d9818-1301-40ef-baa6-372eee86c89f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:16.236459 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-298d9818-1301-40ef-baa6-372eee86c89f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:16.236941 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-298d9818-1301-40ef-baa6-372eee86c89f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:16.237398 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-298d9818-1301-40ef-baa6-372eee86c89f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:16.238080 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-298d9818-1301-40ef-baa6-372eee86c89f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:16.238533 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-298d9818-1301-40ef-baa6-372eee86c89f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:16.238980 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-298d9818-1301-40ef-baa6-372eee86c89f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:16.253585 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-f65f0f4b-1169-4891-8e65-9a5294578bc9 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:16.254255 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-f65f0f4b-1169-4891-8e65-9a5294578bc9 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 8cbb99ff-b818-4de4-9dde-a3c27164f6af] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:16.261707 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f65f0f4b-1169-4891-8e65-9a5294578bc9 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:16.262201 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f65f0f4b-1169-4891-8e65-9a5294578bc9 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:16.262635 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f65f0f4b-1169-4891-8e65-9a5294578bc9 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:16.263366 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f65f0f4b-1169-4891-8e65-9a5294578bc9 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:16.263871 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f65f0f4b-1169-4891-8e65-9a5294578bc9 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:16.264293 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f65f0f4b-1169-4891-8e65-9a5294578bc9 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:16.325032 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-f65f0f4b-1169-4891-8e65-9a5294578bc9 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:16.333162 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-f65f0f4b-1169-4891-8e65-9a5294578bc9 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af" status: 200 len: 1294 microversion: 2.1 time: 0.083329 Sep 03 03:53:16.333735 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 316/631] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:16 2022] GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af => generated 1294 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:16.368887 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-298d9818-1301-40ef-baa6-372eee86c89f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:16.376740 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-298d9818-1301-40ef-baa6-372eee86c89f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1678 microversion: 2.1 time: 0.154286 Sep 03 03:53:16.377297 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 316/632] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:16 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:16.705591 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-92d90715-9e35-4490-9ef6-1934cc69cbb9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:16.706181 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-92d90715-9e35-4490-9ef6-1934cc69cbb9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:16.712148 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-92d90715-9e35-4490-9ef6-1934cc69cbb9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:16.712624 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-92d90715-9e35-4490-9ef6-1934cc69cbb9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:16.713074 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-92d90715-9e35-4490-9ef6-1934cc69cbb9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:16.713749 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-92d90715-9e35-4490-9ef6-1934cc69cbb9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:16.714187 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-92d90715-9e35-4490-9ef6-1934cc69cbb9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:16.714646 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-92d90715-9e35-4490-9ef6-1934cc69cbb9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:16.909001 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-92d90715-9e35-4490-9ef6-1934cc69cbb9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:16.918122 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-92d90715-9e35-4490-9ef6-1934cc69cbb9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1724 microversion: 2.1 time: 0.216449 Sep 03 03:53:16.918792 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 317/633] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:16 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:17.357092 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-add0afdf-b596-4345-b545-a4e6fb3b525f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:17.357734 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-add0afdf-b596-4345-b545-a4e6fb3b525f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 8cbb99ff-b818-4de4-9dde-a3c27164f6af] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:17.364468 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-add0afdf-b596-4345-b545-a4e6fb3b525f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:17.364991 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-add0afdf-b596-4345-b545-a4e6fb3b525f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:17.365421 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-add0afdf-b596-4345-b545-a4e6fb3b525f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:17.366131 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-add0afdf-b596-4345-b545-a4e6fb3b525f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:17.366568 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-add0afdf-b596-4345-b545-a4e6fb3b525f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:17.367020 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-add0afdf-b596-4345-b545-a4e6fb3b525f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:17.402122 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-47134f30-87de-4df2-ac5c-0cdd6302e0ec tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:17.402885 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-47134f30-87de-4df2-ac5c-0cdd6302e0ec tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:17.412280 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-47134f30-87de-4df2-ac5c-0cdd6302e0ec tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:17.413762 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-47134f30-87de-4df2-ac5c-0cdd6302e0ec tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:17.414223 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-47134f30-87de-4df2-ac5c-0cdd6302e0ec tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:17.414999 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-47134f30-87de-4df2-ac5c-0cdd6302e0ec tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:17.415449 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-47134f30-87de-4df2-ac5c-0cdd6302e0ec tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:17.415865 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-47134f30-87de-4df2-ac5c-0cdd6302e0ec tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:17.434019 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-add0afdf-b596-4345-b545-a4e6fb3b525f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:17.441985 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-add0afdf-b596-4345-b545-a4e6fb3b525f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af" status: 200 len: 1302 microversion: 2.1 time: 0.089275 Sep 03 03:53:17.442825 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 317/634] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:17 2022] GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af => generated 1302 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:17.555585 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-47134f30-87de-4df2-ac5c-0cdd6302e0ec tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:17.563483 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-47134f30-87de-4df2-ac5c-0cdd6302e0ec tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1655 microversion: 2.1 time: 0.167136 Sep 03 03:53:17.564325 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 318/635] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:17 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1655 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:17.586489 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-bc54fdcf-494b-40ad-93b2-95eaeb1839c2 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:53:17.593096 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bc54fdcf-494b-40ad-93b2-95eaeb1839c2 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:17.593571 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bc54fdcf-494b-40ad-93b2-95eaeb1839c2 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:17.593968 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bc54fdcf-494b-40ad-93b2-95eaeb1839c2 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:17.616739 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-bc54fdcf-494b-40ad-93b2-95eaeb1839c2 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Going to try to start instance {{(pid=132077) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 03 03:53:17.662986 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-bc54fdcf-494b-40ad-93b2-95eaeb1839c2 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "POST /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731/action" status: 202 len: 0 microversion: 2.1 time: 0.080269 Sep 03 03:53:17.663600 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 318/636] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Sep 3 03:53:17 2022] POST /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 03:53:17.672201 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-7e1f2864-1d3c-4d1e-ba6e-1ed3024ebf1c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:17.672808 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-7e1f2864-1d3c-4d1e-ba6e-1ed3024ebf1c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:17.678917 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7e1f2864-1d3c-4d1e-ba6e-1ed3024ebf1c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:17.679410 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7e1f2864-1d3c-4d1e-ba6e-1ed3024ebf1c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:17.679847 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7e1f2864-1d3c-4d1e-ba6e-1ed3024ebf1c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:17.680534 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7e1f2864-1d3c-4d1e-ba6e-1ed3024ebf1c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:17.681004 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7e1f2864-1d3c-4d1e-ba6e-1ed3024ebf1c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:17.681428 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7e1f2864-1d3c-4d1e-ba6e-1ed3024ebf1c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:17.685382 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell1:SELECT=100 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:53:17.898989 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-7e1f2864-1d3c-4d1e-ba6e-1ed3024ebf1c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:17.906675 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-7e1f2864-1d3c-4d1e-ba6e-1ed3024ebf1c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1664 microversion: 2.1 time: 0.238333 Sep 03 03:53:17.911487 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 319/637] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:17 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1664 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:17.942653 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-9ce503b1-97f4-4291-9b6f-d7af27a7da78 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:17.943765 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-9ce503b1-97f4-4291-9b6f-d7af27a7da78 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:17.950777 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9ce503b1-97f4-4291-9b6f-d7af27a7da78 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:17.951559 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9ce503b1-97f4-4291-9b6f-d7af27a7da78 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:17.952179 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9ce503b1-97f4-4291-9b6f-d7af27a7da78 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:17.952889 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9ce503b1-97f4-4291-9b6f-d7af27a7da78 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:17.953347 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9ce503b1-97f4-4291-9b6f-d7af27a7da78 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:17.953772 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9ce503b1-97f4-4291-9b6f-d7af27a7da78 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:18.178961 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-9ce503b1-97f4-4291-9b6f-d7af27a7da78 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:18.187363 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-9ce503b1-97f4-4291-9b6f-d7af27a7da78 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1730 microversion: 2.1 time: 0.249328 Sep 03 03:53:18.187927 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 319/638] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:17 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1730 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:18.210715 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-2a471eb2-e88b-458b-a0d5-3b054436a582 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:18.211518 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-2a471eb2-e88b-458b-a0d5-3b054436a582 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:18.218428 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2a471eb2-e88b-458b-a0d5-3b054436a582 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:18.219255 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2a471eb2-e88b-458b-a0d5-3b054436a582 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:18.219688 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2a471eb2-e88b-458b-a0d5-3b054436a582 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:18.220391 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2a471eb2-e88b-458b-a0d5-3b054436a582 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:18.220833 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2a471eb2-e88b-458b-a0d5-3b054436a582 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:18.221424 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2a471eb2-e88b-458b-a0d5-3b054436a582 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:18.465630 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-ff9bb9b2-8783-4fc6-a461-2b52d28b32a6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:18.466431 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-ff9bb9b2-8783-4fc6-a461-2b52d28b32a6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 8cbb99ff-b818-4de4-9dde-a3c27164f6af] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:18.474347 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ff9bb9b2-8783-4fc6-a461-2b52d28b32a6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:18.475177 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ff9bb9b2-8783-4fc6-a461-2b52d28b32a6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:18.475605 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ff9bb9b2-8783-4fc6-a461-2b52d28b32a6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:18.476521 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ff9bb9b2-8783-4fc6-a461-2b52d28b32a6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:18.476942 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ff9bb9b2-8783-4fc6-a461-2b52d28b32a6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:18.477409 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ff9bb9b2-8783-4fc6-a461-2b52d28b32a6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:18.556523 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-2a471eb2-e88b-458b-a0d5-3b054436a582 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.349084 Sep 03 03:53:18.558691 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 320/639] 10.222.0.25 () {58 vars in 1275 bytes} [Sat Sep 3 03:53:18 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2/os-interface => generated 285 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 03:53:18.571050 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-ff9bb9b2-8783-4fc6-a461-2b52d28b32a6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:18.581668 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-ff9bb9b2-8783-4fc6-a461-2b52d28b32a6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af" status: 200 len: 1300 microversion: 2.1 time: 0.120147 Sep 03 03:53:18.582852 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 320/640] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:18 2022] GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af => generated 1300 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:18.932783 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-394092b7-d9be-4968-b4d1-2e0cc65920a3 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:18.933675 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-394092b7-d9be-4968-b4d1-2e0cc65920a3 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:18.940800 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-394092b7-d9be-4968-b4d1-2e0cc65920a3 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:18.941518 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-394092b7-d9be-4968-b4d1-2e0cc65920a3 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:18.941947 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-394092b7-d9be-4968-b4d1-2e0cc65920a3 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:18.942627 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-394092b7-d9be-4968-b4d1-2e0cc65920a3 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:18.943175 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-394092b7-d9be-4968-b4d1-2e0cc65920a3 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:18.943589 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-394092b7-d9be-4968-b4d1-2e0cc65920a3 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:19.252983 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-394092b7-d9be-4968-b4d1-2e0cc65920a3 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:19.260902 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-394092b7-d9be-4968-b4d1-2e0cc65920a3 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1664 microversion: 2.1 time: 0.331948 Sep 03 03:53:19.261667 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 321/641] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:18 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1664 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:19.600015 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-caf57fe7-4ee2-4c88-ab72-f69a91fd6234 req-462092e5-7315-449c-8c34-5a7b72bca3b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f5b827b-0905-4360-b0b5-f5881a029bc2", "tag": "9f1ab985-1982-45d9-b595-93496be6d12f"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:53:19.606139 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-40792e9c-4d73-404a-94c3-8633daec4dbe tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:19.607799 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-40792e9c-4d73-404a-94c3-8633daec4dbe tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 8cbb99ff-b818-4de4-9dde-a3c27164f6af] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:19.627565 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-40792e9c-4d73-404a-94c3-8633daec4dbe tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:19.630966 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-caf57fe7-4ee2-4c88-ab72-f69a91fd6234 req-462092e5-7315-449c-8c34-5a7b72bca3b7 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:19.631974 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-40792e9c-4d73-404a-94c3-8633daec4dbe tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:19.632635 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-40792e9c-4d73-404a-94c3-8633daec4dbe tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:19.633578 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-40792e9c-4d73-404a-94c3-8633daec4dbe tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:19.635029 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-40792e9c-4d73-404a-94c3-8633daec4dbe tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:19.635990 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-caf57fe7-4ee2-4c88-ab72-f69a91fd6234 req-462092e5-7315-449c-8c34-5a7b72bca3b7 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:19.637119 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-caf57fe7-4ee2-4c88-ab72-f69a91fd6234 req-462092e5-7315-449c-8c34-5a7b72bca3b7 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:19.637508 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-40792e9c-4d73-404a-94c3-8633daec4dbe tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:19.668421 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-caf57fe7-4ee2-4c88-ab72-f69a91fd6234 req-462092e5-7315-449c-8c34-5a7b72bca3b7 service nova] Creating event network-changed:9f1ab985-1982-45d9-b595-93496be6d12f for instance 4f5b827b-0905-4360-b0b5-f5881a029bc2 on hv-cinder-79966 Sep 03 03:53:19.674796 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-caf57fe7-4ee2-4c88-ab72-f69a91fd6234 req-462092e5-7315-449c-8c34-5a7b72bca3b7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078660 Sep 03 03:53:19.683047 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 321/642] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:53:19.898501 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-40792e9c-4d73-404a-94c3-8633daec4dbe tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:19.907538 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-40792e9c-4d73-404a-94c3-8633daec4dbe tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af" status: 200 len: 1368 microversion: 2.1 time: 0.305369 Sep 03 03:53:19.908275 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 322/643] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:19 2022] GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af => generated 1368 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:20.283255 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell0:SELECT=4 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:53:20.289246 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-c67c3695-ee35-47ef-ae65-58852e70f1a1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:20.290015 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-c67c3695-ee35-47ef-ae65-58852e70f1a1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:20.298277 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c67c3695-ee35-47ef-ae65-58852e70f1a1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:20.298758 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c67c3695-ee35-47ef-ae65-58852e70f1a1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:20.299239 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c67c3695-ee35-47ef-ae65-58852e70f1a1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:20.300144 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c67c3695-ee35-47ef-ae65-58852e70f1a1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:20.300592 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c67c3695-ee35-47ef-ae65-58852e70f1a1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:20.301002 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c67c3695-ee35-47ef-ae65-58852e70f1a1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:20.446181 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-c67c3695-ee35-47ef-ae65-58852e70f1a1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:20.456344 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-c67c3695-ee35-47ef-ae65-58852e70f1a1 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1668 microversion: 2.1 time: 0.175215 Sep 03 03:53:20.457524 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 322/644] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:20 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1668 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:20.537829 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-00b41755-1426-46a9-991c-28945598fef1 req-abfbad54-0e56-4819-a755-2e5f60341b09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cbb99ff-b818-4de4-9dde-a3c27164f6af", "tag": "d1286d66-938e-4851-b4f8-27c123ccbf56"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:53:20.548294 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-00b41755-1426-46a9-991c-28945598fef1 req-abfbad54-0e56-4819-a755-2e5f60341b09 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:20.549106 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-00b41755-1426-46a9-991c-28945598fef1 req-abfbad54-0e56-4819-a755-2e5f60341b09 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:20.549695 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-00b41755-1426-46a9-991c-28945598fef1 req-abfbad54-0e56-4819-a755-2e5f60341b09 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:20.562950 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-00b41755-1426-46a9-991c-28945598fef1 req-abfbad54-0e56-4819-a755-2e5f60341b09 service nova] Creating event network-changed:d1286d66-938e-4851-b4f8-27c123ccbf56 for instance 8cbb99ff-b818-4de4-9dde-a3c27164f6af on hv-cinder-79966 Sep 03 03:53:20.567973 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-00b41755-1426-46a9-991c-28945598fef1 req-abfbad54-0e56-4819-a755-2e5f60341b09 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033792 Sep 03 03:53:20.568953 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 323/645] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:53:20.931157 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-b48cf09a-db9e-4e3d-87de-f9aeb4a0a723 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:20.931879 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-b48cf09a-db9e-4e3d-87de-f9aeb4a0a723 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 8cbb99ff-b818-4de4-9dde-a3c27164f6af] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:20.938662 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b48cf09a-db9e-4e3d-87de-f9aeb4a0a723 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:20.939294 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b48cf09a-db9e-4e3d-87de-f9aeb4a0a723 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:20.939785 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b48cf09a-db9e-4e3d-87de-f9aeb4a0a723 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:20.940557 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b48cf09a-db9e-4e3d-87de-f9aeb4a0a723 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:20.941068 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b48cf09a-db9e-4e3d-87de-f9aeb4a0a723 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:20.941491 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b48cf09a-db9e-4e3d-87de-f9aeb4a0a723 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:21.072562 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-b48cf09a-db9e-4e3d-87de-f9aeb4a0a723 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:21.080685 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-b48cf09a-db9e-4e3d-87de-f9aeb4a0a723 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af" status: 200 len: 1368 microversion: 2.1 time: 0.153461 Sep 03 03:53:21.081248 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 323/646] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:20 2022] GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:21.703732 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-7bf8b742-a4df-43d7-b6af-f1bf6e226ad0 req-3aa9e32d-ab61-4cab-8912-3bf2906915e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f5b827b-0905-4360-b0b5-f5881a029bc2", "tag": "9f1ab985-1982-45d9-b595-93496be6d12f"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:53:21.718226 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell0:SELECT=2 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:53:21.725370 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-7bf8b742-a4df-43d7-b6af-f1bf6e226ad0 req-3aa9e32d-ab61-4cab-8912-3bf2906915e0 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:21.725862 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-7bf8b742-a4df-43d7-b6af-f1bf6e226ad0 req-3aa9e32d-ab61-4cab-8912-3bf2906915e0 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:21.726267 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-7bf8b742-a4df-43d7-b6af-f1bf6e226ad0 req-3aa9e32d-ab61-4cab-8912-3bf2906915e0 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:21.737339 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-7bf8b742-a4df-43d7-b6af-f1bf6e226ad0 req-3aa9e32d-ab61-4cab-8912-3bf2906915e0 service nova] Creating event network-changed:9f1ab985-1982-45d9-b595-93496be6d12f for instance 4f5b827b-0905-4360-b0b5-f5881a029bc2 on hv-cinder-79966 Sep 03 03:53:21.742424 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-7bf8b742-a4df-43d7-b6af-f1bf6e226ad0 req-3aa9e32d-ab61-4cab-8912-3bf2906915e0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052562 Sep 03 03:53:21.743021 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 324/647] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:53:22.108969 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-fcd8ba9d-3151-46c2-a280-e6e0c1a98162 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:22.109570 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-fcd8ba9d-3151-46c2-a280-e6e0c1a98162 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 8cbb99ff-b818-4de4-9dde-a3c27164f6af] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:22.116342 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fcd8ba9d-3151-46c2-a280-e6e0c1a98162 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:22.116816 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fcd8ba9d-3151-46c2-a280-e6e0c1a98162 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:22.117245 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fcd8ba9d-3151-46c2-a280-e6e0c1a98162 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:22.117917 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fcd8ba9d-3151-46c2-a280-e6e0c1a98162 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:22.118364 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fcd8ba9d-3151-46c2-a280-e6e0c1a98162 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:22.118770 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fcd8ba9d-3151-46c2-a280-e6e0c1a98162 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:22.260178 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-fcd8ba9d-3151-46c2-a280-e6e0c1a98162 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:22.268530 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-fcd8ba9d-3151-46c2-a280-e6e0c1a98162 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af" status: 200 len: 1368 microversion: 2.1 time: 0.167026 Sep 03 03:53:22.269122 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 324/648] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:22 2022] GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:23.292496 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell0:SELECT=8 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:53:23.297501 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-f6973ef4-0f67-4bf1-af05-8717bfc5fcef tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:23.298229 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-f6973ef4-0f67-4bf1-af05-8717bfc5fcef tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 8cbb99ff-b818-4de4-9dde-a3c27164f6af] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:23.304770 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f6973ef4-0f67-4bf1-af05-8717bfc5fcef tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:23.305242 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f6973ef4-0f67-4bf1-af05-8717bfc5fcef tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:23.305667 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f6973ef4-0f67-4bf1-af05-8717bfc5fcef tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:23.306346 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f6973ef4-0f67-4bf1-af05-8717bfc5fcef tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:23.306798 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f6973ef4-0f67-4bf1-af05-8717bfc5fcef tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:23.307238 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f6973ef4-0f67-4bf1-af05-8717bfc5fcef tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:23.453248 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-f6973ef4-0f67-4bf1-af05-8717bfc5fcef tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:23.461270 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-f6973ef4-0f67-4bf1-af05-8717bfc5fcef tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af" status: 200 len: 1368 microversion: 2.1 time: 0.172211 Sep 03 03:53:23.461834 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 325/649] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:23 2022] GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:24.013650 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-6ff1b72d-c6ad-4e88-ba85-29e391ed6115 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:24.014265 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-6ff1b72d-c6ad-4e88-ba85-29e391ed6115 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:24.020825 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6ff1b72d-c6ad-4e88-ba85-29e391ed6115 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:24.021290 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6ff1b72d-c6ad-4e88-ba85-29e391ed6115 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:24.021735 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6ff1b72d-c6ad-4e88-ba85-29e391ed6115 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:24.022410 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6ff1b72d-c6ad-4e88-ba85-29e391ed6115 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:24.022906 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6ff1b72d-c6ad-4e88-ba85-29e391ed6115 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:24.023339 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6ff1b72d-c6ad-4e88-ba85-29e391ed6115 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:24.053108 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-6ff1b72d-c6ad-4e88-ba85-29e391ed6115 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78/os-volume_attachments/f84e91c4-8e6a-451b-9551-fe5c7727f2b4" status: 200 len: 194 microversion: 2.20 time: 0.043471 Sep 03 03:53:24.053894 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 325/650] 10.222.0.25 () {60 vars in 1454 bytes} [Sat Sep 3 03:53:24 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78/os-volume_attachments/f84e91c4-8e6a-451b-9551-fe5c7727f2b4 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 03:53:24.125943 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-ca999aa0-5138-46ec-831d-f79b576af7e6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:24.126451 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-ca999aa0-5138-46ec-831d-f79b576af7e6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:24.132709 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ca999aa0-5138-46ec-831d-f79b576af7e6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:24.133114 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ca999aa0-5138-46ec-831d-f79b576af7e6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:24.133538 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ca999aa0-5138-46ec-831d-f79b576af7e6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:24.134213 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ca999aa0-5138-46ec-831d-f79b576af7e6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:24.134653 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ca999aa0-5138-46ec-831d-f79b576af7e6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:24.135127 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ca999aa0-5138-46ec-831d-f79b576af7e6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:24.217238 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.objects.instance [None req-ca999aa0-5138-46ec-831d-f79b576af7e6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lazy-loading 'services' on Instance uuid 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 {{(pid=132076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 03:53:24.291909 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-ca999aa0-5138-46ec-831d-f79b576af7e6 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "DELETE /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78/os-volume_attachments/f84e91c4-8e6a-451b-9551-fe5c7727f2b4" status: 202 len: 0 microversion: 2.20 time: 0.170036 Sep 03 03:53:24.292502 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 326/651] 10.222.0.25 () {60 vars in 1457 bytes} [Sat Sep 3 03:53:24 2022] DELETE /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78/os-volume_attachments/f84e91c4-8e6a-451b-9551-fe5c7727f2b4 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 03 03:53:24.301276 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-f568ffa8-d642-467d-9898-e0367eeb4807 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:24.303623 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-f568ffa8-d642-467d-9898-e0367eeb4807 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:24.309800 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f568ffa8-d642-467d-9898-e0367eeb4807 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:24.310289 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f568ffa8-d642-467d-9898-e0367eeb4807 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:24.310714 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f568ffa8-d642-467d-9898-e0367eeb4807 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:24.311706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f568ffa8-d642-467d-9898-e0367eeb4807 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:24.312191 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f568ffa8-d642-467d-9898-e0367eeb4807 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:24.312727 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f568ffa8-d642-467d-9898-e0367eeb4807 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:24.343788 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-f568ffa8-d642-467d-9898-e0367eeb4807 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046764 Sep 03 03:53:24.344351 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 326/652] 10.222.0.25 () {60 vars in 1343 bytes} [Sat Sep 3 03:53:24 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 03:53:24.486853 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-18bad3e4-0c3e-4e0e-868f-7fb667f3ebc3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:24.487714 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-18bad3e4-0c3e-4e0e-868f-7fb667f3ebc3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 8cbb99ff-b818-4de4-9dde-a3c27164f6af] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:24.495705 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-18bad3e4-0c3e-4e0e-868f-7fb667f3ebc3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:24.496273 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-18bad3e4-0c3e-4e0e-868f-7fb667f3ebc3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:24.496771 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-18bad3e4-0c3e-4e0e-868f-7fb667f3ebc3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:24.497476 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-18bad3e4-0c3e-4e0e-868f-7fb667f3ebc3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:24.498004 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-18bad3e4-0c3e-4e0e-868f-7fb667f3ebc3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:24.498657 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-18bad3e4-0c3e-4e0e-868f-7fb667f3ebc3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:24.638120 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-18bad3e4-0c3e-4e0e-868f-7fb667f3ebc3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:24.646039 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-18bad3e4-0c3e-4e0e-868f-7fb667f3ebc3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af" status: 200 len: 1368 microversion: 2.1 time: 0.164766 Sep 03 03:53:24.646598 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 327/653] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:24 2022] GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:25.356249 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-24901149-939e-4339-a741-3c008b5c9b57 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:25.358835 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-24901149-939e-4339-a741-3c008b5c9b57 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:25.365676 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-24901149-939e-4339-a741-3c008b5c9b57 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:25.366148 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-24901149-939e-4339-a741-3c008b5c9b57 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:25.366554 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-24901149-939e-4339-a741-3c008b5c9b57 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:25.367275 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-24901149-939e-4339-a741-3c008b5c9b57 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:25.367717 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-24901149-939e-4339-a741-3c008b5c9b57 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:25.368128 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-24901149-939e-4339-a741-3c008b5c9b57 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:25.398222 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-24901149-939e-4339-a741-3c008b5c9b57 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046119 Sep 03 03:53:25.398762 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 327/654] 10.222.0.25 () {60 vars in 1343 bytes} [Sat Sep 3 03:53:25 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 03:53:25.669726 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-22ecb49f-fc69-477c-8478-001ea9033ce8 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:25.670408 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-22ecb49f-fc69-477c-8478-001ea9033ce8 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 8cbb99ff-b818-4de4-9dde-a3c27164f6af] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:25.677344 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-22ecb49f-fc69-477c-8478-001ea9033ce8 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:25.677817 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-22ecb49f-fc69-477c-8478-001ea9033ce8 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:25.678241 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-22ecb49f-fc69-477c-8478-001ea9033ce8 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:25.679051 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-22ecb49f-fc69-477c-8478-001ea9033ce8 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:25.679498 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-22ecb49f-fc69-477c-8478-001ea9033ce8 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:25.679910 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-22ecb49f-fc69-477c-8478-001ea9033ce8 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:25.815709 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-22ecb49f-fc69-477c-8478-001ea9033ce8 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:25.823623 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-22ecb49f-fc69-477c-8478-001ea9033ce8 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af" status: 200 len: 1368 microversion: 2.1 time: 0.158172 Sep 03 03:53:25.824201 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 328/655] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:25 2022] GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:26.410900 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-e77b5a12-579e-4e5b-afed-23231bd5e25b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:26.413059 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-e77b5a12-579e-4e5b-afed-23231bd5e25b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:26.419766 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e77b5a12-579e-4e5b-afed-23231bd5e25b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:26.420243 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e77b5a12-579e-4e5b-afed-23231bd5e25b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:26.420684 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e77b5a12-579e-4e5b-afed-23231bd5e25b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:26.421318 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e77b5a12-579e-4e5b-afed-23231bd5e25b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:26.421822 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e77b5a12-579e-4e5b-afed-23231bd5e25b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:26.422232 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e77b5a12-579e-4e5b-afed-23231bd5e25b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:26.439996 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:53:26.453343 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-e77b5a12-579e-4e5b-afed-23231bd5e25b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046407 Sep 03 03:53:26.453941 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 328/656] 10.222.0.25 () {60 vars in 1343 bytes} [Sat Sep 3 03:53:26 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:26.521096 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-ab394cbc-326d-4fb5-a685-9d41669777e5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:26.521651 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-ab394cbc-326d-4fb5-a685-9d41669777e5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:26.527680 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ab394cbc-326d-4fb5-a685-9d41669777e5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:26.528154 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ab394cbc-326d-4fb5-a685-9d41669777e5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:26.528585 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ab394cbc-326d-4fb5-a685-9d41669777e5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:26.529456 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ab394cbc-326d-4fb5-a685-9d41669777e5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:26.529904 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ab394cbc-326d-4fb5-a685-9d41669777e5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:26.530318 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ab394cbc-326d-4fb5-a685-9d41669777e5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:26.554851 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-ab394cbc-326d-4fb5-a685-9d41669777e5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Going to try to terminate instance {{(pid=132076) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 03:53:26.632833 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-ab394cbc-326d-4fb5-a685-9d41669777e5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "DELETE /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 204 len: 0 microversion: 2.20 time: 0.115548 Sep 03 03:53:26.633431 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 329/657] 10.222.0.25 () {60 vars in 1280 bytes} [Sat Sep 3 03:53:26 2022] DELETE /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 03 03:53:26.642364 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-fb0ae370-7da3-4bbe-81e6-2295e524b030 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:26.643638 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-fb0ae370-7da3-4bbe-81e6-2295e524b030 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:26.646564 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:53:26.652776 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fb0ae370-7da3-4bbe-81e6-2295e524b030 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:26.653251 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fb0ae370-7da3-4bbe-81e6-2295e524b030 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:26.653672 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fb0ae370-7da3-4bbe-81e6-2295e524b030 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:26.654358 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fb0ae370-7da3-4bbe-81e6-2295e524b030 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:26.654795 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fb0ae370-7da3-4bbe-81e6-2295e524b030 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:26.655319 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fb0ae370-7da3-4bbe-81e6-2295e524b030 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:26.796421 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-fb0ae370-7da3-4bbe-81e6-2295e524b030 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:26.804636 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-fb0ae370-7da3-4bbe-81e6-2295e524b030 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:26.806050 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-fb0ae370-7da3-4bbe-81e6-2295e524b030 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:26.807216 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-fb0ae370-7da3-4bbe-81e6-2295e524b030 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1723 microversion: 2.20 time: 0.169443 Sep 03 03:53:26.807769 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 329/658] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:53:26 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:53:26.846729 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-84d25e4f-6029-4a3f-a324-bacade3d1ec3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:26.847451 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-84d25e4f-6029-4a3f-a324-bacade3d1ec3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 8cbb99ff-b818-4de4-9dde-a3c27164f6af] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:26.854076 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-84d25e4f-6029-4a3f-a324-bacade3d1ec3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:26.854560 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-84d25e4f-6029-4a3f-a324-bacade3d1ec3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:26.855033 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-84d25e4f-6029-4a3f-a324-bacade3d1ec3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:26.855722 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-84d25e4f-6029-4a3f-a324-bacade3d1ec3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:26.856164 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-84d25e4f-6029-4a3f-a324-bacade3d1ec3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:26.856553 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-84d25e4f-6029-4a3f-a324-bacade3d1ec3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:26.991733 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-84d25e4f-6029-4a3f-a324-bacade3d1ec3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:26.999471 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-84d25e4f-6029-4a3f-a324-bacade3d1ec3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af" status: 200 len: 1368 microversion: 2.1 time: 0.157061 Sep 03 03:53:26.999974 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 330/659] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:26 2022] GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:27.832731 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-27299c10-34f3-4858-81cf-d9cc3d2e8f5f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:27.833325 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-27299c10-34f3-4858-81cf-d9cc3d2e8f5f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:27.839794 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-27299c10-34f3-4858-81cf-d9cc3d2e8f5f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:27.840277 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-27299c10-34f3-4858-81cf-d9cc3d2e8f5f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:27.840705 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-27299c10-34f3-4858-81cf-d9cc3d2e8f5f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:27.841504 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-27299c10-34f3-4858-81cf-d9cc3d2e8f5f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:27.842047 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-27299c10-34f3-4858-81cf-d9cc3d2e8f5f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:27.842463 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-27299c10-34f3-4858-81cf-d9cc3d2e8f5f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:27.985079 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-27299c10-34f3-4858-81cf-d9cc3d2e8f5f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:27.993650 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-27299c10-34f3-4858-81cf-d9cc3d2e8f5f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:27.995106 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-27299c10-34f3-4858-81cf-d9cc3d2e8f5f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:27.996291 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-27299c10-34f3-4858-81cf-d9cc3d2e8f5f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1723 microversion: 2.20 time: 0.167787 Sep 03 03:53:27.996912 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 330/660] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:53:27 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:53:28.021756 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-894167cb-73c7-4887-a6ff-bb996cfea61f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:28.022360 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-894167cb-73c7-4887-a6ff-bb996cfea61f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 8cbb99ff-b818-4de4-9dde-a3c27164f6af] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:28.029155 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-894167cb-73c7-4887-a6ff-bb996cfea61f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:28.029640 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-894167cb-73c7-4887-a6ff-bb996cfea61f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:28.030069 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-894167cb-73c7-4887-a6ff-bb996cfea61f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:28.030742 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-894167cb-73c7-4887-a6ff-bb996cfea61f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:28.031229 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-894167cb-73c7-4887-a6ff-bb996cfea61f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:28.031652 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-894167cb-73c7-4887-a6ff-bb996cfea61f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:28.435080 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-894167cb-73c7-4887-a6ff-bb996cfea61f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:28.443244 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-894167cb-73c7-4887-a6ff-bb996cfea61f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af" status: 200 len: 1368 microversion: 2.1 time: 0.425274 Sep 03 03:53:28.443785 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 331/661] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:28 2022] GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af => generated 1368 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:29.022600 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-ad95d4d5-08e3-4a65-b96b-94d8d44519b8 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:29.023337 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-ad95d4d5-08e3-4a65-b96b-94d8d44519b8 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:29.030288 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ad95d4d5-08e3-4a65-b96b-94d8d44519b8 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:29.032621 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ad95d4d5-08e3-4a65-b96b-94d8d44519b8 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:29.033065 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ad95d4d5-08e3-4a65-b96b-94d8d44519b8 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:29.040139 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ad95d4d5-08e3-4a65-b96b-94d8d44519b8 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:29.040616 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ad95d4d5-08e3-4a65-b96b-94d8d44519b8 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:29.041043 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ad95d4d5-08e3-4a65-b96b-94d8d44519b8 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:29.105823 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-ad95d4d5-08e3-4a65-b96b-94d8d44519b8 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:29.114496 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-ad95d4d5-08e3-4a65-b96b-94d8d44519b8 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:29.115905 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-ad95d4d5-08e3-4a65-b96b-94d8d44519b8 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:29.117057 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-ad95d4d5-08e3-4a65-b96b-94d8d44519b8 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 200 len: 1655 microversion: 2.20 time: 0.098969 Sep 03 03:53:29.117589 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 331/662] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:53:29 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 1655 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:53:29.279692 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-c8c13676-7b6b-4888-a19b-d22834af4472 req-d9c57a0f-f090-4cf6-bd14-584d7bbb37bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d61f1c-d865-4d0d-89a9-1f91f0f8bf78", "name": "network-vif-deleted", "tag": "dc502e70-8b66-4849-929e-0879ed88e591"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:53:29.292109 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-c8c13676-7b6b-4888-a19b-d22834af4472 req-d9c57a0f-f090-4cf6-bd14-584d7bbb37bb service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:29.292793 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-c8c13676-7b6b-4888-a19b-d22834af4472 req-d9c57a0f-f090-4cf6-bd14-584d7bbb37bb service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:29.293312 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-c8c13676-7b6b-4888-a19b-d22834af4472 req-d9c57a0f-f090-4cf6-bd14-584d7bbb37bb service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:29.309493 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-c8c13676-7b6b-4888-a19b-d22834af4472 req-d9c57a0f-f090-4cf6-bd14-584d7bbb37bb service nova] Creating event network-vif-deleted:dc502e70-8b66-4849-929e-0879ed88e591 for instance 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 on hv-cinder-79966 Sep 03 03:53:29.314254 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-c8c13676-7b6b-4888-a19b-d22834af4472 req-d9c57a0f-f090-4cf6-bd14-584d7bbb37bb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038257 Sep 03 03:53:29.314868 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 332/663] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:53:29.465928 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-4657deb5-1e8c-47bb-80cc-6f9bf057b259 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:29.466568 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-4657deb5-1e8c-47bb-80cc-6f9bf057b259 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 8cbb99ff-b818-4de4-9dde-a3c27164f6af] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:29.479299 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4657deb5-1e8c-47bb-80cc-6f9bf057b259 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:29.479704 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4657deb5-1e8c-47bb-80cc-6f9bf057b259 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:29.480133 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4657deb5-1e8c-47bb-80cc-6f9bf057b259 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:29.483796 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4657deb5-1e8c-47bb-80cc-6f9bf057b259 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:29.484278 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4657deb5-1e8c-47bb-80cc-6f9bf057b259 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:29.484713 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4657deb5-1e8c-47bb-80cc-6f9bf057b259 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:29.639759 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-4657deb5-1e8c-47bb-80cc-6f9bf057b259 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:29.649427 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-4657deb5-1e8c-47bb-80cc-6f9bf057b259 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af" status: 200 len: 1368 microversion: 2.1 time: 0.187431 Sep 03 03:53:29.649966 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 332/664] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:29 2022] GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:30.142612 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-6176d50e-c6f6-4f5a-ad95-46e4f80e8351 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:30.144434 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-6176d50e-c6f6-4f5a-ad95-46e4f80e8351 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:30.150767 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6176d50e-c6f6-4f5a-ad95-46e4f80e8351 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:30.151343 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6176d50e-c6f6-4f5a-ad95-46e4f80e8351 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:30.151783 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6176d50e-c6f6-4f5a-ad95-46e4f80e8351 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:30.152641 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6176d50e-c6f6-4f5a-ad95-46e4f80e8351 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:30.153089 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6176d50e-c6f6-4f5a-ad95-46e4f80e8351 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:30.153673 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6176d50e-c6f6-4f5a-ad95-46e4f80e8351 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:30.169654 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.wsgi [None req-6176d50e-c6f6-4f5a-ad95-46e4f80e8351 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] HTTP exception thrown: Instance 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 could not be found. Sep 03 03:53:30.171440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-6176d50e-c6f6-4f5a-ad95-46e4f80e8351 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Request method failure captured: Sep 03 03:53:30.171440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: request: GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 HTTP/1.1 Sep 03 03:53:30.171440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept: application/json Sep 03 03:53:30.171440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept-Encoding: identity Sep 03 03:53:30.171440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Connection: close Sep 03 03:53:30.171440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Length: 0 Sep 03 03:53:30.171440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Type: application/json Sep 03 03:53:30.171440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Host: 10.222.0.25 Sep 03 03:53:30.171440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Openstack-System-Scope: None Sep 03 03:53:30.171440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: User-Agent: python-urllib3/1.26.12 Sep 03 03:53:30.171440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Auth-Token: gAAAAABjEs69BRGC6P6wBJAUTmtITvT_vIw0gPds8bq0Ck7UAz1bo7CB8mFb-VFBiBFm8hZHRYtPTy2K0wjbLuKWVIEOTzAutTGmbrr-bFM_gcnv-f2-BjsF6yImlUNPqD-nULDssJKi4jaJ6RtDHDHo4FVzgRyBXvdxlqqtKqS0j7ZF8HSGrRo Sep 03 03:53:30.171440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Id: None Sep 03 03:53:30.171440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Name: None Sep 03 03:53:30.171440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Identity-Status: Confirmed Sep 03 03:53:30.171440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Is-Admin-Project: True Sep 03 03:53:30.171440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Openstack-Nova-Api-Version: 2.20 Sep 03 03:53:30.171440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Id: default Sep 03 03:53:30.171440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Name: Default Sep 03 03:53:30.171440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Id: 4d80eadc5cc34322b85201c50b3c6552 Sep 03 03:53:30.171440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1191556674 Sep 03 03:53:30.171440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Role: member,reader Sep 03 03:53:30.171440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Roles: member,reader Sep 03 03:53:30.173226 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d80eadc5cc34322b85201c50b3c6552"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4d80eadc5cc34322b85201c50b3c6552"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4d80eadc5cc34322b85201c50b3c6552"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d80eadc5cc34322b85201c50b3c6552"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:53:30.173226 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1191556674 Sep 03 03:53:30.173226 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Id: 4d80eadc5cc34322b85201c50b3c6552 Sep 03 03:53:30.173226 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1191556674 Sep 03 03:53:30.173226 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User: tempest-AttachVolumeShelveTestJSON-1191556674-project Sep 03 03:53:30.173226 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Id: default Sep 03 03:53:30.173226 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Name: Default Sep 03 03:53:30.173226 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Id: 31a8c62bd81f4c1f863bd952b6976276 Sep 03 03:53:30.173226 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1191556674-project Sep 03 03:53:30.173226 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: method: > Sep 03 03:53:30.173226 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: exception: Instance 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 could not be found. Sep 03 03:53:30.173226 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: action_args: {'id': '52d61f1c-d865-4d0d-89a9-1f91f0f8bf78'} Sep 03 03:53:30.174330 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:53:30.174330 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:53:30.174330 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 03:53:30.174330 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 03:53:30.174330 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 03:53:30.174330 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 03:53:30.174330 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 03:53:30.174330 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 03:53:30.174330 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 03:53:30.174330 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 03:53:30.174330 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 could not be found. Sep 03 03:53:30.174330 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:53:30.174330 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:53:30.174330 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:53:30.174330 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:53:30.174330 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:53:30.174330 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:53:30.174330 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:53:30.174330 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:53:30.174330 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:53:30.175891 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:53:30.175891 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 03:53:30.175891 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 03:53:30.175891 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 03:53:30.175891 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 03:53:30.175891 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 03:53:30.175891 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:53:30.175891 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 could not be found. Sep 03 03:53:30.175891 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:53:30.175891 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:53:30.175891 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:53:30.175891 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:53:30.175891 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:53:30.175891 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:53:30.175891 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:53:30.175891 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:53:30.175891 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 could not be found. Sep 03 03:53:30.175891 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:53:30.177259 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-6176d50e-c6f6-4f5a-ad95-46e4f80e8351 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Returning 404 to user: Instance 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 could not be found. {{(pid=132076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:53:30.177259 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-6176d50e-c6f6-4f5a-ad95-46e4f80e8351 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 404 len: 111 microversion: 2.20 time: 0.034832 Sep 03 03:53:30.177259 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 333/665] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:53:30 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 03 03:53:30.183017 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-3dc4d9a0-5686-4ebd-a31e-13ff92a005c0 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '.version_select at 0x7f45fc5a2550>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:30.203745 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-3dc4d9a0-5686-4ebd-a31e-13ff92a005c0 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-104258169" status: 204 len: 0 microversion: 2.20 time: 0.025008 Sep 03 03:53:30.204448 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 333/666] 10.222.0.25 () {60 vars in 1259 bytes} [Sat Sep 3 03:53:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-104258169 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 03 03:53:30.400291 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-516ed2a5-de5c-413d-95d0-c9eae53d8273 req-e3b4c43c-d12d-412f-b762-063ff9c6d487 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cbb99ff-b818-4de4-9dde-a3c27164f6af", "name": "network-vif-plugged", "status": "completed", "tag": "d1286d66-938e-4851-b4f8-27c123ccbf56"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:53:30.418840 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-516ed2a5-de5c-413d-95d0-c9eae53d8273 req-e3b4c43c-d12d-412f-b762-063ff9c6d487 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:30.419329 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-516ed2a5-de5c-413d-95d0-c9eae53d8273 req-e3b4c43c-d12d-412f-b762-063ff9c6d487 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:30.419749 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-516ed2a5-de5c-413d-95d0-c9eae53d8273 req-e3b4c43c-d12d-412f-b762-063ff9c6d487 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:30.433072 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-516ed2a5-de5c-413d-95d0-c9eae53d8273 req-e3b4c43c-d12d-412f-b762-063ff9c6d487 service nova] Creating event network-vif-plugged:d1286d66-938e-4851-b4f8-27c123ccbf56 for instance 8cbb99ff-b818-4de4-9dde-a3c27164f6af on hv-cinder-79966 Sep 03 03:53:30.438372 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-516ed2a5-de5c-413d-95d0-c9eae53d8273 req-e3b4c43c-d12d-412f-b762-063ff9c6d487 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043489 Sep 03 03:53:30.439020 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 334/667] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:53:30.673161 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-a5f98946-d3cd-4563-b67b-42a0cc829fbe tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:30.673970 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-a5f98946-d3cd-4563-b67b-42a0cc829fbe tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 8cbb99ff-b818-4de4-9dde-a3c27164f6af] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:30.680761 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a5f98946-d3cd-4563-b67b-42a0cc829fbe tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:30.681234 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a5f98946-d3cd-4563-b67b-42a0cc829fbe tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:30.681655 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a5f98946-d3cd-4563-b67b-42a0cc829fbe tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:30.682340 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a5f98946-d3cd-4563-b67b-42a0cc829fbe tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:30.682781 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a5f98946-d3cd-4563-b67b-42a0cc829fbe tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:30.683217 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a5f98946-d3cd-4563-b67b-42a0cc829fbe tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:30.896131 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a5f98946-d3cd-4563-b67b-42a0cc829fbe tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:30.905159 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-a5f98946-d3cd-4563-b67b-42a0cc829fbe tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af" status: 200 len: 1368 microversion: 2.1 time: 0.235718 Sep 03 03:53:30.905655 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 334/668] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:30 2022] GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af => generated 1368 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:30.944649 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-64288c27-b5be-4323-9492-3f716b0928a4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Action: 'create', calling method: .version_select at 0x7f45fc66b3a0>, body: {"keypair": {"name": "tempest-keypair-1463254690", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLa0Q4hvTNKp7HzbCOi5+T1BGamo1etM86HlH1ekxTRD7tvOLDwAjMyNSMLu7UG4spCL0dHxs3LPnEh09HqdmHHPf75oBVAhGX7fc/pNegYSfo4XunxYiGDHxHzcFZZeZw=="}} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:53:30.962131 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.quota [None req-64288c27-b5be-4323-9492-3f716b0928a4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Getting quotas for project 4d80eadc5cc34322b85201c50b3c6552. Resources: {'key_pairs'} {{(pid=132076) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 03:53:30.966060 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.quota [None req-64288c27-b5be-4323-9492-3f716b0928a4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Getting quotas for user 31a8c62bd81f4c1f863bd952b6976276 and project 4d80eadc5cc34322b85201c50b3c6552. Resources: {'key_pairs'} {{(pid=132076) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 03:53:30.990297 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-64288c27-b5be-4323-9492-3f716b0928a4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.051951 Sep 03 03:53:30.990912 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 335/669] 10.222.0.25 () {62 vars in 1200 bytes} [Sat Sep 3 03:53:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 03 03:53:31.929947 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-e8f99328-0797-4b5c-8ac4-9192a8bbe774 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:31.930515 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-e8f99328-0797-4b5c-8ac4-9192a8bbe774 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 8cbb99ff-b818-4de4-9dde-a3c27164f6af] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:31.937290 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e8f99328-0797-4b5c-8ac4-9192a8bbe774 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:31.937776 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e8f99328-0797-4b5c-8ac4-9192a8bbe774 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:31.938206 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e8f99328-0797-4b5c-8ac4-9192a8bbe774 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:31.938970 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e8f99328-0797-4b5c-8ac4-9192a8bbe774 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:31.939420 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e8f99328-0797-4b5c-8ac4-9192a8bbe774 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:31.939837 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e8f99328-0797-4b5c-8ac4-9192a8bbe774 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:32.146026 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-e8f99328-0797-4b5c-8ac4-9192a8bbe774 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:32.154166 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-e8f99328-0797-4b5c-8ac4-9192a8bbe774 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af" status: 200 len: 1368 microversion: 2.1 time: 0.228115 Sep 03 03:53:32.168959 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 335/670] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:31 2022] GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af => generated 1368 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:32.607631 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-b8132afc-9db5-4610-803c-f663ec7033d5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-456422265", "imageRef": "0af209bb-870a-4343-a9f9-de05883bb8dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a31ab79a-5d78-4441-9a2d-dcb13a26f9be"}], "security_groups": [{"name": "tempest-securitygroup--344978079"}], "key_name": "tempest-keypair-1463254690", "user_data": "}} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:53:32.712210 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.network.neutron [None req-b8132afc-9db5-4610-803c-f663ec7033d5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] validate_networks() for [('a31ab79a-5d78-4441-9a2d-dcb13a26f9be', None, None, None, None, None)] {{(pid=132076) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 03:53:33.101006 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-b8132afc-9db5-4610-803c-f663ec7033d5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Flavor limits 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 03:53:33.101421 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-b8132afc-9db5-4610-803c-f663ec7033d5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Image limits 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 03:53:33.101881 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-b8132afc-9db5-4610-803c-f663ec7033d5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Flavor pref 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 03:53:33.102273 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-b8132afc-9db5-4610-803c-f663ec7033d5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Image pref 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 03:53:33.102674 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-b8132afc-9db5-4610-803c-f663ec7033d5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 03:53:33.112651 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b8132afc-9db5-4610-803c-f663ec7033d5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:33.113123 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b8132afc-9db5-4610-803c-f663ec7033d5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:33.113549 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b8132afc-9db5-4610-803c-f663ec7033d5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:33.114260 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b8132afc-9db5-4610-803c-f663ec7033d5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:33.114701 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b8132afc-9db5-4610-803c-f663ec7033d5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:33.115147 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b8132afc-9db5-4610-803c-f663ec7033d5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:33.131600 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.quota [None req-b8132afc-9db5-4610-803c-f663ec7033d5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Getting quotas for project 4d80eadc5cc34322b85201c50b3c6552. Resources: {'ram', 'instances', 'cores'} {{(pid=132076) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 03:53:33.135927 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.quota [None req-b8132afc-9db5-4610-803c-f663ec7033d5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Getting quotas for user 31a8c62bd81f4c1f863bd952b6976276 and project 4d80eadc5cc34322b85201c50b3c6552. Resources: {'ram', 'instances', 'cores'} {{(pid=132076) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 03:53:33.147181 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-b8132afc-9db5-4610-803c-f663ec7033d5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Going to run 1 instances... {{(pid=132076) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 03:53:33.149543 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-b8132afc-9db5-4610-803c-f663ec7033d5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0af209bb-870a-4343-a9f9-de05883bb8dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132076) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 03:53:33.177338 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-c107a2d9-c5e3-42cd-bd0e-bf91e1cea2e6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:33.178009 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-c107a2d9-c5e3-42cd-bd0e-bf91e1cea2e6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 8cbb99ff-b818-4de4-9dde-a3c27164f6af] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:33.184900 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c107a2d9-c5e3-42cd-bd0e-bf91e1cea2e6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:33.185370 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c107a2d9-c5e3-42cd-bd0e-bf91e1cea2e6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:33.185831 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c107a2d9-c5e3-42cd-bd0e-bf91e1cea2e6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:33.186509 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c107a2d9-c5e3-42cd-bd0e-bf91e1cea2e6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:33.186982 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c107a2d9-c5e3-42cd-bd0e-bf91e1cea2e6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:33.187393 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c107a2d9-c5e3-42cd-bd0e-bf91e1cea2e6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:33.201806 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-b8132afc-9db5-4610-803c-f663ec7033d5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.599742 Sep 03 03:53:33.202847 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 336/671] 10.222.0.25 () {62 vars in 1188 bytes} [Sat Sep 3 03:53:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 03 03:53:33.213761 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-6125d99d-a5f2-468f-9a45-5064ebcdbe05 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:33.214364 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-6125d99d-a5f2-468f-9a45-5064ebcdbe05 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:33.221617 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:53:33.276418 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-6125d99d-a5f2-468f-9a45-5064ebcdbe05 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:33.289871 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-6125d99d-a5f2-468f-9a45-5064ebcdbe05 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:33.291449 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-6125d99d-a5f2-468f-9a45-5064ebcdbe05 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:33.292557 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-6125d99d-a5f2-468f-9a45-5064ebcdbe05 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1281 microversion: 2.20 time: 0.082912 Sep 03 03:53:33.293109 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 337/672] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:53:33 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1281 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:53:33.336472 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-c107a2d9-c5e3-42cd-bd0e-bf91e1cea2e6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:33.344182 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-c107a2d9-c5e3-42cd-bd0e-bf91e1cea2e6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af" status: 200 len: 1557 microversion: 2.1 time: 0.170682 Sep 03 03:53:33.344783 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 336/673] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:33 2022] GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af => generated 1557 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:33.368261 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-0f07b475-b7bf-4b96-97b9-5feff9a68dd0 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:33.368261 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-0f07b475-b7bf-4b96-97b9-5feff9a68dd0 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 8cbb99ff-b818-4de4-9dde-a3c27164f6af] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:33.374311 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0f07b475-b7bf-4b96-97b9-5feff9a68dd0 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:33.374884 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0f07b475-b7bf-4b96-97b9-5feff9a68dd0 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:33.375384 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0f07b475-b7bf-4b96-97b9-5feff9a68dd0 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:33.376368 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0f07b475-b7bf-4b96-97b9-5feff9a68dd0 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:33.376946 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0f07b475-b7bf-4b96-97b9-5feff9a68dd0 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:33.377330 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0f07b475-b7bf-4b96-97b9-5feff9a68dd0 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:33.467983 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-0f07b475-b7bf-4b96-97b9-5feff9a68dd0 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104797 Sep 03 03:53:33.474120 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 338/674] 10.222.0.25 () {58 vars in 1275 bytes} [Sat Sep 3 03:53:33 2022] GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:53:34.317608 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-a16ff2dc-de4c-4c93-b6e3-70dff84e9163 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:34.318180 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-a16ff2dc-de4c-4c93-b6e3-70dff84e9163 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:34.324912 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a16ff2dc-de4c-4c93-b6e3-70dff84e9163 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:34.325391 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a16ff2dc-de4c-4c93-b6e3-70dff84e9163 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:34.325811 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a16ff2dc-de4c-4c93-b6e3-70dff84e9163 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:34.326493 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a16ff2dc-de4c-4c93-b6e3-70dff84e9163 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:34.326987 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a16ff2dc-de4c-4c93-b6e3-70dff84e9163 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:34.327398 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a16ff2dc-de4c-4c93-b6e3-70dff84e9163 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:34.408548 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a16ff2dc-de4c-4c93-b6e3-70dff84e9163 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:34.416999 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a16ff2dc-de4c-4c93-b6e3-70dff84e9163 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:34.418443 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a16ff2dc-de4c-4c93-b6e3-70dff84e9163 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:34.419569 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-a16ff2dc-de4c-4c93-b6e3-70dff84e9163 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1333 microversion: 2.20 time: 0.105964 Sep 03 03:53:34.420089 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 337/675] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:53:34 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1333 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:53:34.477097 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-7203ccf5-dc10-4fb9-a231-05c4b8318463 req-5c1b7d6f-8721-47fe-83bc-0543d7f0b0ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cbb99ff-b818-4de4-9dde-a3c27164f6af", "tag": "d1286d66-938e-4851-b4f8-27c123ccbf56"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:53:34.491629 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-7203ccf5-dc10-4fb9-a231-05c4b8318463 req-5c1b7d6f-8721-47fe-83bc-0543d7f0b0ae service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:34.492541 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-7203ccf5-dc10-4fb9-a231-05c4b8318463 req-5c1b7d6f-8721-47fe-83bc-0543d7f0b0ae service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:34.493109 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-7203ccf5-dc10-4fb9-a231-05c4b8318463 req-5c1b7d6f-8721-47fe-83bc-0543d7f0b0ae service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:34.505137 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-7203ccf5-dc10-4fb9-a231-05c4b8318463 req-5c1b7d6f-8721-47fe-83bc-0543d7f0b0ae service nova] Creating event network-changed:d1286d66-938e-4851-b4f8-27c123ccbf56 for instance 8cbb99ff-b818-4de4-9dde-a3c27164f6af on hv-cinder-79966 Sep 03 03:53:34.510691 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-7203ccf5-dc10-4fb9-a231-05c4b8318463 req-5c1b7d6f-8721-47fe-83bc-0543d7f0b0ae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037309 Sep 03 03:53:34.511561 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 339/676] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:53:35.445124 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-9e0d44dd-d1a4-4296-91a2-dd48bd946bd4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:35.446209 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-9e0d44dd-d1a4-4296-91a2-dd48bd946bd4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:35.457492 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9e0d44dd-d1a4-4296-91a2-dd48bd946bd4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:35.458262 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9e0d44dd-d1a4-4296-91a2-dd48bd946bd4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:35.458910 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9e0d44dd-d1a4-4296-91a2-dd48bd946bd4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:35.460208 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9e0d44dd-d1a4-4296-91a2-dd48bd946bd4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:35.461058 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9e0d44dd-d1a4-4296-91a2-dd48bd946bd4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:35.461639 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9e0d44dd-d1a4-4296-91a2-dd48bd946bd4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:35.554084 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-9e0d44dd-d1a4-4296-91a2-dd48bd946bd4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:35.563100 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-9e0d44dd-d1a4-4296-91a2-dd48bd946bd4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:35.564846 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-9e0d44dd-d1a4-4296-91a2-dd48bd946bd4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:35.566860 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-9e0d44dd-d1a4-4296-91a2-dd48bd946bd4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1339 microversion: 2.20 time: 0.125609 Sep 03 03:53:35.580561 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 338/677] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:53:35 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1339 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:53:36.436212 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-c1fcc1cf-457e-4944-92bb-1ec2f4875375 req-4fa96efc-d125-4423-80ad-48fe22fd7edf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc53cf40-e9bf-4403-92b0-7bae49adae43", "tag": "1f618203-8c7d-4d80-8d91-954bafd0d268"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:53:36.446412 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-c1fcc1cf-457e-4944-92bb-1ec2f4875375 req-4fa96efc-d125-4423-80ad-48fe22fd7edf service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:36.446909 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-c1fcc1cf-457e-4944-92bb-1ec2f4875375 req-4fa96efc-d125-4423-80ad-48fe22fd7edf service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:36.447456 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-c1fcc1cf-457e-4944-92bb-1ec2f4875375 req-4fa96efc-d125-4423-80ad-48fe22fd7edf service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:36.458682 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-c1fcc1cf-457e-4944-92bb-1ec2f4875375 req-4fa96efc-d125-4423-80ad-48fe22fd7edf service nova] Creating event network-changed:1f618203-8c7d-4d80-8d91-954bafd0d268 for instance cc53cf40-e9bf-4403-92b0-7bae49adae43 on hv-cinder-79966 Sep 03 03:53:36.463450 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-c1fcc1cf-457e-4944-92bb-1ec2f4875375 req-4fa96efc-d125-4423-80ad-48fe22fd7edf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031841 Sep 03 03:53:36.464048 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 340/678] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:53:36.593785 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-7df53491-10f5-4317-be6d-80a5833af662 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:36.594320 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-7df53491-10f5-4317-be6d-80a5833af662 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:36.601057 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7df53491-10f5-4317-be6d-80a5833af662 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:36.601544 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7df53491-10f5-4317-be6d-80a5833af662 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:36.601978 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7df53491-10f5-4317-be6d-80a5833af662 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:36.602730 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7df53491-10f5-4317-be6d-80a5833af662 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:36.603272 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7df53491-10f5-4317-be6d-80a5833af662 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:36.603725 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7df53491-10f5-4317-be6d-80a5833af662 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:36.735357 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-7df53491-10f5-4317-be6d-80a5833af662 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:36.743482 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-7df53491-10f5-4317-be6d-80a5833af662 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:36.744898 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-7df53491-10f5-4317-be6d-80a5833af662 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:36.745988 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-7df53491-10f5-4317-be6d-80a5833af662 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1406 microversion: 2.20 time: 0.156271 Sep 03 03:53:36.746549 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 339/679] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:53:36 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:53:37.776722 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-fe57da07-4c99-40c0-a453-3a924a91aae4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:37.777871 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-fe57da07-4c99-40c0-a453-3a924a91aae4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:37.788546 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fe57da07-4c99-40c0-a453-3a924a91aae4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:37.789326 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fe57da07-4c99-40c0-a453-3a924a91aae4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:37.790070 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fe57da07-4c99-40c0-a453-3a924a91aae4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:37.791186 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fe57da07-4c99-40c0-a453-3a924a91aae4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:37.791924 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fe57da07-4c99-40c0-a453-3a924a91aae4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:37.792611 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fe57da07-4c99-40c0-a453-3a924a91aae4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:37.813798 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:53:37.965304 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-fe57da07-4c99-40c0-a453-3a924a91aae4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:37.973738 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-fe57da07-4c99-40c0-a453-3a924a91aae4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:37.975216 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-fe57da07-4c99-40c0-a453-3a924a91aae4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:37.976312 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-fe57da07-4c99-40c0-a453-3a924a91aae4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1406 microversion: 2.20 time: 0.207476 Sep 03 03:53:37.976873 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 341/680] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:53:37 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:53:39.001467 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-10a68af9-3219-44ad-891b-7d8dc3286c04 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:39.002071 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-10a68af9-3219-44ad-891b-7d8dc3286c04 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:39.009431 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-10a68af9-3219-44ad-891b-7d8dc3286c04 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:39.009913 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-10a68af9-3219-44ad-891b-7d8dc3286c04 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:39.010340 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-10a68af9-3219-44ad-891b-7d8dc3286c04 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:39.011079 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-10a68af9-3219-44ad-891b-7d8dc3286c04 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:39.011533 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-10a68af9-3219-44ad-891b-7d8dc3286c04 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:39.011950 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-10a68af9-3219-44ad-891b-7d8dc3286c04 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:39.149445 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-10a68af9-3219-44ad-891b-7d8dc3286c04 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:39.162460 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-10a68af9-3219-44ad-891b-7d8dc3286c04 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:39.164684 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-10a68af9-3219-44ad-891b-7d8dc3286c04 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:39.166338 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-10a68af9-3219-44ad-891b-7d8dc3286c04 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1406 microversion: 2.20 time: 0.168724 Sep 03 03:53:39.167202 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 340/681] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:53:38 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:53:40.192054 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-b2ba0517-39d7-4e35-80d9-febb81f6478d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:40.192707 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-b2ba0517-39d7-4e35-80d9-febb81f6478d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:40.199570 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b2ba0517-39d7-4e35-80d9-febb81f6478d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:40.200055 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b2ba0517-39d7-4e35-80d9-febb81f6478d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:40.200471 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b2ba0517-39d7-4e35-80d9-febb81f6478d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:40.201148 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b2ba0517-39d7-4e35-80d9-febb81f6478d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:40.201596 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b2ba0517-39d7-4e35-80d9-febb81f6478d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:40.202020 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b2ba0517-39d7-4e35-80d9-febb81f6478d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:40.340009 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-b2ba0517-39d7-4e35-80d9-febb81f6478d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:40.349272 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-b2ba0517-39d7-4e35-80d9-febb81f6478d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:40.351064 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-b2ba0517-39d7-4e35-80d9-febb81f6478d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:40.352238 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-b2ba0517-39d7-4e35-80d9-febb81f6478d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1406 microversion: 2.20 time: 0.164201 Sep 03 03:53:40.352798 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 342/682] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:53:40 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:53:41.382477 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-b8cdb62f-0057-416d-820d-54a9bb03900e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:41.383523 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-b8cdb62f-0057-416d-820d-54a9bb03900e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:41.393167 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b8cdb62f-0057-416d-820d-54a9bb03900e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:41.393664 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b8cdb62f-0057-416d-820d-54a9bb03900e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:41.394197 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b8cdb62f-0057-416d-820d-54a9bb03900e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:41.394890 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b8cdb62f-0057-416d-820d-54a9bb03900e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:41.395338 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b8cdb62f-0057-416d-820d-54a9bb03900e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:41.395781 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b8cdb62f-0057-416d-820d-54a9bb03900e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:41.536345 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-b8cdb62f-0057-416d-820d-54a9bb03900e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:41.544948 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-b8cdb62f-0057-416d-820d-54a9bb03900e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:41.546357 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-b8cdb62f-0057-416d-820d-54a9bb03900e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:41.547574 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-b8cdb62f-0057-416d-820d-54a9bb03900e tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1406 microversion: 2.20 time: 0.171594 Sep 03 03:53:41.548134 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 341/683] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:53:41 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:53:42.328263 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-e8ef2128-b94d-413f-b21b-5a1aa4b4d9aa req-6fadf9e0-fdb5-42ca-a7b7-43f5f9eaf424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc53cf40-e9bf-4403-92b0-7bae49adae43", "name": "network-vif-plugged", "status": "completed", "tag": "1f618203-8c7d-4d80-8d91-954bafd0d268"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:53:42.338228 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-e8ef2128-b94d-413f-b21b-5a1aa4b4d9aa req-6fadf9e0-fdb5-42ca-a7b7-43f5f9eaf424 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:42.338700 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-e8ef2128-b94d-413f-b21b-5a1aa4b4d9aa req-6fadf9e0-fdb5-42ca-a7b7-43f5f9eaf424 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:42.339142 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-e8ef2128-b94d-413f-b21b-5a1aa4b4d9aa req-6fadf9e0-fdb5-42ca-a7b7-43f5f9eaf424 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:42.350229 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-e8ef2128-b94d-413f-b21b-5a1aa4b4d9aa req-6fadf9e0-fdb5-42ca-a7b7-43f5f9eaf424 service nova] Creating event network-vif-plugged:1f618203-8c7d-4d80-8d91-954bafd0d268 for instance cc53cf40-e9bf-4403-92b0-7bae49adae43 on hv-cinder-79966 Sep 03 03:53:42.355069 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-e8ef2128-b94d-413f-b21b-5a1aa4b4d9aa req-6fadf9e0-fdb5-42ca-a7b7-43f5f9eaf424 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030336 Sep 03 03:53:42.355630 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 343/684] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:53:42.572381 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-ab406fba-eaaf-4877-9daa-a1aaf041ade0 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:42.573133 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-ab406fba-eaaf-4877-9daa-a1aaf041ade0 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:42.579989 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ab406fba-eaaf-4877-9daa-a1aaf041ade0 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:42.580464 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ab406fba-eaaf-4877-9daa-a1aaf041ade0 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:42.580914 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ab406fba-eaaf-4877-9daa-a1aaf041ade0 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:42.581617 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ab406fba-eaaf-4877-9daa-a1aaf041ade0 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:42.582054 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ab406fba-eaaf-4877-9daa-a1aaf041ade0 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:42.582474 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ab406fba-eaaf-4877-9daa-a1aaf041ade0 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:42.712479 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-ab406fba-eaaf-4877-9daa-a1aaf041ade0 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:42.721024 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-ab406fba-eaaf-4877-9daa-a1aaf041ade0 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:42.722454 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-ab406fba-eaaf-4877-9daa-a1aaf041ade0 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:42.723611 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-ab406fba-eaaf-4877-9daa-a1aaf041ade0 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1406 microversion: 2.20 time: 0.155161 Sep 03 03:53:42.724176 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 342/685] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:53:42 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:53:43.746453 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell0:SELECT=2 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:53:43.747258 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell0:SELECT=12 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:53:43.751701 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-9b27024d-841e-44ac-9745-40ce5e9af721 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:43.752382 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-9b27024d-841e-44ac-9745-40ce5e9af721 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:43.759262 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9b27024d-841e-44ac-9745-40ce5e9af721 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:43.759748 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9b27024d-841e-44ac-9745-40ce5e9af721 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:43.760152 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9b27024d-841e-44ac-9745-40ce5e9af721 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:43.760818 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9b27024d-841e-44ac-9745-40ce5e9af721 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:43.761259 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9b27024d-841e-44ac-9745-40ce5e9af721 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:43.761748 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9b27024d-841e-44ac-9745-40ce5e9af721 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:43.910004 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-9b27024d-841e-44ac-9745-40ce5e9af721 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:43.923162 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-9b27024d-841e-44ac-9745-40ce5e9af721 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:43.924577 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-9b27024d-841e-44ac-9745-40ce5e9af721 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:43.925666 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-9b27024d-841e-44ac-9745-40ce5e9af721 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1406 microversion: 2.20 time: 0.180237 Sep 03 03:53:43.926224 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 344/686] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:53:43 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:53:44.959307 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-0d388383-008b-46fe-8046-39747a3cafcd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:44.960238 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-0d388383-008b-46fe-8046-39747a3cafcd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:44.970584 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0d388383-008b-46fe-8046-39747a3cafcd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:44.971102 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0d388383-008b-46fe-8046-39747a3cafcd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:44.971540 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0d388383-008b-46fe-8046-39747a3cafcd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:44.972234 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0d388383-008b-46fe-8046-39747a3cafcd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:44.972683 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0d388383-008b-46fe-8046-39747a3cafcd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:44.973104 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0d388383-008b-46fe-8046-39747a3cafcd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:45.116506 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-0d388383-008b-46fe-8046-39747a3cafcd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:45.125474 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-0d388383-008b-46fe-8046-39747a3cafcd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:45.126944 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-0d388383-008b-46fe-8046-39747a3cafcd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:45.128096 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-0d388383-008b-46fe-8046-39747a3cafcd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1598 microversion: 2.20 time: 0.175378 Sep 03 03:53:45.128673 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 343/687] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:53:44 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1598 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:53:45.152286 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-dbdf9429-8b4a-4961-a9fe-b6d5e9080ba5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:45.152790 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-dbdf9429-8b4a-4961-a9fe-b6d5e9080ba5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:45.159690 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-dbdf9429-8b4a-4961-a9fe-b6d5e9080ba5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:45.160165 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-dbdf9429-8b4a-4961-a9fe-b6d5e9080ba5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:45.160598 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-dbdf9429-8b4a-4961-a9fe-b6d5e9080ba5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:45.161273 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-dbdf9429-8b4a-4961-a9fe-b6d5e9080ba5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:45.161717 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-dbdf9429-8b4a-4961-a9fe-b6d5e9080ba5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:45.162133 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-dbdf9429-8b4a-4961-a9fe-b6d5e9080ba5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:45.239730 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-dbdf9429-8b4a-4961-a9fe-b6d5e9080ba5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091245 Sep 03 03:53:45.240297 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 345/688] 10.222.0.25 () {60 vars in 1316 bytes} [Sat Sep 3 03:53:45 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 03:53:46.411571 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-b2e7fe9f-4055-4434-91ca-fb3ff48a0308 req-56ec3606-217b-4b65-b996-f666e04e42ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc53cf40-e9bf-4403-92b0-7bae49adae43", "tag": "1f618203-8c7d-4d80-8d91-954bafd0d268"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:53:46.421367 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-b2e7fe9f-4055-4434-91ca-fb3ff48a0308 req-56ec3606-217b-4b65-b996-f666e04e42ff service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:46.421833 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-b2e7fe9f-4055-4434-91ca-fb3ff48a0308 req-56ec3606-217b-4b65-b996-f666e04e42ff service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:46.422249 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-b2e7fe9f-4055-4434-91ca-fb3ff48a0308 req-56ec3606-217b-4b65-b996-f666e04e42ff service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:46.433431 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-b2e7fe9f-4055-4434-91ca-fb3ff48a0308 req-56ec3606-217b-4b65-b996-f666e04e42ff service nova] Creating event network-changed:1f618203-8c7d-4d80-8d91-954bafd0d268 for instance cc53cf40-e9bf-4403-92b0-7bae49adae43 on hv-cinder-79966 Sep 03 03:53:46.438610 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-b2e7fe9f-4055-4434-91ca-fb3ff48a0308 req-56ec3606-217b-4b65-b996-f666e04e42ff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030787 Sep 03 03:53:46.439514 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 344/689] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:53:54.913003 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-5c1b1517-eb43-4da6-8d12-0dca1a598832 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:54.913529 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-5c1b1517-eb43-4da6-8d12-0dca1a598832 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:54.919689 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5c1b1517-eb43-4da6-8d12-0dca1a598832 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:54.920169 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5c1b1517-eb43-4da6-8d12-0dca1a598832 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:54.920600 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5c1b1517-eb43-4da6-8d12-0dca1a598832 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:54.921290 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5c1b1517-eb43-4da6-8d12-0dca1a598832 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:54.921742 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5c1b1517-eb43-4da6-8d12-0dca1a598832 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:54.922161 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5c1b1517-eb43-4da6-8d12-0dca1a598832 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:55.007038 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.objects.instance [None req-5c1b1517-eb43-4da6-8d12-0dca1a598832 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lazy-loading 'services' on Instance uuid 4f5b827b-0905-4360-b0b5-f5881a029bc2 {{(pid=132076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 03:53:55.097325 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-5c1b1517-eb43-4da6-8d12-0dca1a598832 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2/os-volume_attachments/c1fc6664-e084-4952-b7af-ebe490548b8f" status: 202 len: 0 microversion: 2.1 time: 0.188314 Sep 03 03:53:55.098034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 346/690] 10.222.0.25 () {58 vars in 1416 bytes} [Sat Sep 3 03:53:54 2022] DELETE /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2/os-volume_attachments/c1fc6664-e084-4952-b7af-ebe490548b8f => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 03:53:55.109333 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-6486b6e4-a5ed-45f9-a462-7d174bba3395 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:55.111616 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-6486b6e4-a5ed-45f9-a462-7d174bba3395 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:55.118462 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6486b6e4-a5ed-45f9-a462-7d174bba3395 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:55.118975 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6486b6e4-a5ed-45f9-a462-7d174bba3395 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:55.119406 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6486b6e4-a5ed-45f9-a462-7d174bba3395 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:55.120161 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6486b6e4-a5ed-45f9-a462-7d174bba3395 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:55.120741 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6486b6e4-a5ed-45f9-a462-7d174bba3395 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:55.121163 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6486b6e4-a5ed-45f9-a462-7d174bba3395 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:55.154602 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-6486b6e4-a5ed-45f9-a462-7d174bba3395 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050701 Sep 03 03:53:55.155187 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 345/691] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Sep 3 03:53:55 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:53:56.173424 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-0f55526b-dcb3-4350-b148-d601377a329f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:56.177088 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-0f55526b-dcb3-4350-b148-d601377a329f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:56.185783 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0f55526b-dcb3-4350-b148-d601377a329f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:56.186263 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0f55526b-dcb3-4350-b148-d601377a329f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:56.186698 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0f55526b-dcb3-4350-b148-d601377a329f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:56.187435 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0f55526b-dcb3-4350-b148-d601377a329f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:56.187894 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0f55526b-dcb3-4350-b148-d601377a329f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:56.188315 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0f55526b-dcb3-4350-b148-d601377a329f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:56.217592 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-0f55526b-dcb3-4350-b148-d601377a329f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052296 Sep 03 03:53:56.218143 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 347/692] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Sep 3 03:53:56 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 03:53:56.305355 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-3d0dc213-da66-45b7-8851-c033b8bd7375 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:56.305921 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-3d0dc213-da66-45b7-8851-c033b8bd7375 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:56.312503 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3d0dc213-da66-45b7-8851-c033b8bd7375 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:56.312985 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3d0dc213-da66-45b7-8851-c033b8bd7375 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:56.313417 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3d0dc213-da66-45b7-8851-c033b8bd7375 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:56.314102 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3d0dc213-da66-45b7-8851-c033b8bd7375 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:56.314549 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3d0dc213-da66-45b7-8851-c033b8bd7375 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:56.315001 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3d0dc213-da66-45b7-8851-c033b8bd7375 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:56.340054 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-3d0dc213-da66-45b7-8851-c033b8bd7375 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Going to try to terminate instance {{(pid=132077) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 03:53:56.342828 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell1:SELECT=100 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:53:56.418457 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-3d0dc213-da66-45b7-8851-c033b8bd7375 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 204 len: 0 microversion: 2.1 time: 0.116782 Sep 03 03:53:56.419164 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 346/693] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Sep 3 03:53:56 2022] DELETE /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 03:53:56.427724 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-5c434569-9bf8-4f5a-a035-b08e4eae0fed tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:56.428242 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-5c434569-9bf8-4f5a-a035-b08e4eae0fed tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:56.434251 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5c434569-9bf8-4f5a-a035-b08e4eae0fed tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:56.434726 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5c434569-9bf8-4f5a-a035-b08e4eae0fed tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:56.435250 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5c434569-9bf8-4f5a-a035-b08e4eae0fed tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:56.435906 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5c434569-9bf8-4f5a-a035-b08e4eae0fed tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:56.436349 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5c434569-9bf8-4f5a-a035-b08e4eae0fed tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:56.436759 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5c434569-9bf8-4f5a-a035-b08e4eae0fed tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:56.583702 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-5c434569-9bf8-4f5a-a035-b08e4eae0fed tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:56.596379 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-5c434569-9bf8-4f5a-a035-b08e4eae0fed tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1690 microversion: 2.1 time: 0.172482 Sep 03 03:53:56.597191 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 348/694] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:56 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1690 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:53:57.627825 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-d942646d-7873-4aaf-91e6-25d63adf61fa tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:57.628986 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-d942646d-7873-4aaf-91e6-25d63adf61fa tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:57.632661 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:53:57.641220 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d942646d-7873-4aaf-91e6-25d63adf61fa tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:57.642007 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d942646d-7873-4aaf-91e6-25d63adf61fa tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:57.642712 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d942646d-7873-4aaf-91e6-25d63adf61fa tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:57.643892 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d942646d-7873-4aaf-91e6-25d63adf61fa tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:57.644632 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d942646d-7873-4aaf-91e6-25d63adf61fa tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:57.645429 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d942646d-7873-4aaf-91e6-25d63adf61fa tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:57.986109 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-d942646d-7873-4aaf-91e6-25d63adf61fa tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:57.994090 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-d942646d-7873-4aaf-91e6-25d63adf61fa tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1690 microversion: 2.1 time: 0.373492 Sep 03 03:53:57.994661 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 347/695] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:57 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1690 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:53:59.021440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-85543d0d-6a36-4257-9920-dfff5d603c8f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:53:59.022394 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-85543d0d-6a36-4257-9920-dfff5d603c8f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:53:59.032389 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-85543d0d-6a36-4257-9920-dfff5d603c8f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:59.032881 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-85543d0d-6a36-4257-9920-dfff5d603c8f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:59.033307 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-85543d0d-6a36-4257-9920-dfff5d603c8f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:59.033987 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-85543d0d-6a36-4257-9920-dfff5d603c8f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:53:59.034430 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-85543d0d-6a36-4257-9920-dfff5d603c8f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:53:59.034843 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-85543d0d-6a36-4257-9920-dfff5d603c8f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:53:59.229770 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-85543d0d-6a36-4257-9920-dfff5d603c8f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:53:59.238402 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-85543d0d-6a36-4257-9920-dfff5d603c8f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1690 microversion: 2.1 time: 0.223406 Sep 03 03:53:59.240312 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 349/696] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:53:59 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1690 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:00.263170 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-de7d86b0-a18c-43df-9a79-2a68dd2bc5da tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:00.263840 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-de7d86b0-a18c-43df-9a79-2a68dd2bc5da tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:00.270355 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-de7d86b0-a18c-43df-9a79-2a68dd2bc5da tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:00.270838 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-de7d86b0-a18c-43df-9a79-2a68dd2bc5da tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:00.271302 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-de7d86b0-a18c-43df-9a79-2a68dd2bc5da tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:00.272035 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-de7d86b0-a18c-43df-9a79-2a68dd2bc5da tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:00.272485 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-de7d86b0-a18c-43df-9a79-2a68dd2bc5da tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:00.272899 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-de7d86b0-a18c-43df-9a79-2a68dd2bc5da tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:00.401967 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-de7d86b0-a18c-43df-9a79-2a68dd2bc5da tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:00.410543 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-de7d86b0-a18c-43df-9a79-2a68dd2bc5da tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1690 microversion: 2.1 time: 0.152212 Sep 03 03:54:00.411192 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 348/697] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:00 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:00.612795 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-2c8285e1-99ea-40fe-a289-0f60eca943bd tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:00.614969 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-2c8285e1-99ea-40fe-a289-0f60eca943bd tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:00.621706 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2c8285e1-99ea-40fe-a289-0f60eca943bd tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:00.622207 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2c8285e1-99ea-40fe-a289-0f60eca943bd tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:00.622650 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2c8285e1-99ea-40fe-a289-0f60eca943bd tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:00.623371 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2c8285e1-99ea-40fe-a289-0f60eca943bd tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:00.623824 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2c8285e1-99ea-40fe-a289-0f60eca943bd tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:00.624369 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2c8285e1-99ea-40fe-a289-0f60eca943bd tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:00.653882 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-2c8285e1-99ea-40fe-a289-0f60eca943bd tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045040 Sep 03 03:54:00.654432 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 350/698] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Sep 3 03:54:00 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 03:54:00.718572 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-0655ffd0-52a2-4e8c-824f-155e0efe80be tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:00.719161 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-0655ffd0-52a2-4e8c-824f-155e0efe80be tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:00.725296 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0655ffd0-52a2-4e8c-824f-155e0efe80be tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:00.725855 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0655ffd0-52a2-4e8c-824f-155e0efe80be tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:00.726249 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0655ffd0-52a2-4e8c-824f-155e0efe80be tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:00.727215 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0655ffd0-52a2-4e8c-824f-155e0efe80be tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:00.727677 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0655ffd0-52a2-4e8c-824f-155e0efe80be tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:00.728144 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0655ffd0-52a2-4e8c-824f-155e0efe80be tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:00.753651 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-0655ffd0-52a2-4e8c-824f-155e0efe80be tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Going to try to terminate instance {{(pid=132077) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 03:54:00.831578 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-0655ffd0-52a2-4e8c-824f-155e0efe80be tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "DELETE /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 204 len: 0 microversion: 2.1 time: 0.116745 Sep 03 03:54:00.832194 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 349/699] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Sep 3 03:54:00 2022] DELETE /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 03 03:54:00.841662 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-e8f2cee8-6bfe-49d1-835f-efdbe1b7afdf tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:00.842366 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-e8f2cee8-6bfe-49d1-835f-efdbe1b7afdf tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:00.848472 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e8f2cee8-6bfe-49d1-835f-efdbe1b7afdf tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:00.849031 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e8f2cee8-6bfe-49d1-835f-efdbe1b7afdf tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:00.849527 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e8f2cee8-6bfe-49d1-835f-efdbe1b7afdf tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:00.850282 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e8f2cee8-6bfe-49d1-835f-efdbe1b7afdf tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:00.850814 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e8f2cee8-6bfe-49d1-835f-efdbe1b7afdf tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:00.851308 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e8f2cee8-6bfe-49d1-835f-efdbe1b7afdf tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:01.090837 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-e8f2cee8-6bfe-49d1-835f-efdbe1b7afdf tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:01.100214 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-e8f2cee8-6bfe-49d1-835f-efdbe1b7afdf tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1674 microversion: 2.1 time: 0.262804 Sep 03 03:54:01.100809 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 351/700] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:00 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1674 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:01.326448 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-d1528945-844c-4571-afbe-d5742acb0398 req-2ab0a07d-495e-47ab-8fda-f8c0f6e8434b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f5b827b-0905-4360-b0b5-f5881a029bc2", "name": "network-vif-deleted", "tag": "9f1ab985-1982-45d9-b595-93496be6d12f"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:54:01.336291 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-d1528945-844c-4571-afbe-d5742acb0398 req-2ab0a07d-495e-47ab-8fda-f8c0f6e8434b service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:01.336745 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-d1528945-844c-4571-afbe-d5742acb0398 req-2ab0a07d-495e-47ab-8fda-f8c0f6e8434b service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:01.337123 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-d1528945-844c-4571-afbe-d5742acb0398 req-2ab0a07d-495e-47ab-8fda-f8c0f6e8434b service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:01.351398 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-d1528945-844c-4571-afbe-d5742acb0398 req-2ab0a07d-495e-47ab-8fda-f8c0f6e8434b service nova] Creating event network-vif-deleted:9f1ab985-1982-45d9-b595-93496be6d12f for instance 4f5b827b-0905-4360-b0b5-f5881a029bc2 on hv-cinder-79966 Sep 03 03:54:01.356812 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-d1528945-844c-4571-afbe-d5742acb0398 req-2ab0a07d-495e-47ab-8fda-f8c0f6e8434b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034079 Sep 03 03:54:01.357602 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 350/701] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:54:01.434447 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-a4174515-8f95-4fae-a2aa-cda223f2620f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:01.435190 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-a4174515-8f95-4fae-a2aa-cda223f2620f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:01.441993 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a4174515-8f95-4fae-a2aa-cda223f2620f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:01.442577 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a4174515-8f95-4fae-a2aa-cda223f2620f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:01.443081 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a4174515-8f95-4fae-a2aa-cda223f2620f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:01.443844 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a4174515-8f95-4fae-a2aa-cda223f2620f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:01.444352 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a4174515-8f95-4fae-a2aa-cda223f2620f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:01.444767 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a4174515-8f95-4fae-a2aa-cda223f2620f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:01.513349 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-a4174515-8f95-4fae-a2aa-cda223f2620f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:01.521576 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-a4174515-8f95-4fae-a2aa-cda223f2620f tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1623 microversion: 2.1 time: 0.091731 Sep 03 03:54:01.522159 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 352/702] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:01 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1623 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:02.125753 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-ae3869ce-afc2-4d9c-8a52-4f5fade96dbd tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:02.126727 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-ae3869ce-afc2-4d9c-8a52-4f5fade96dbd tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:02.133799 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ae3869ce-afc2-4d9c-8a52-4f5fade96dbd tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:02.134317 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ae3869ce-afc2-4d9c-8a52-4f5fade96dbd tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:02.134747 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ae3869ce-afc2-4d9c-8a52-4f5fade96dbd tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:02.135523 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ae3869ce-afc2-4d9c-8a52-4f5fade96dbd tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:02.135915 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ae3869ce-afc2-4d9c-8a52-4f5fade96dbd tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:02.136366 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ae3869ce-afc2-4d9c-8a52-4f5fade96dbd tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:02.276417 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-ae3869ce-afc2-4d9c-8a52-4f5fade96dbd tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:02.284646 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-ae3869ce-afc2-4d9c-8a52-4f5fade96dbd tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1674 microversion: 2.1 time: 0.163273 Sep 03 03:54:02.285219 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 351/703] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:02 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:02.547290 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-b1fd54f7-b4f1-4ad2-b121-b1f4f0ffeff0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:02.547947 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-b1fd54f7-b4f1-4ad2-b121-b1f4f0ffeff0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:02.554209 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b1fd54f7-b4f1-4ad2-b121-b1f4f0ffeff0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:02.555088 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b1fd54f7-b4f1-4ad2-b121-b1f4f0ffeff0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:02.555694 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b1fd54f7-b4f1-4ad2-b121-b1f4f0ffeff0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:02.556408 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b1fd54f7-b4f1-4ad2-b121-b1f4f0ffeff0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:02.556852 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b1fd54f7-b4f1-4ad2-b121-b1f4f0ffeff0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:02.557258 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b1fd54f7-b4f1-4ad2-b121-b1f4f0ffeff0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:02.622907 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-b1fd54f7-b4f1-4ad2-b121-b1f4f0ffeff0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:02.631961 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-b1fd54f7-b4f1-4ad2-b121-b1f4f0ffeff0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 200 len: 1623 microversion: 2.1 time: 0.090214 Sep 03 03:54:02.632567 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 353/704] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:02 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 1623 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:03.311488 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-af428d45-2cfd-496a-8b19-2764313ced69 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:03.312440 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-af428d45-2cfd-496a-8b19-2764313ced69 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:03.322173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-af428d45-2cfd-496a-8b19-2764313ced69 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:03.322990 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-af428d45-2cfd-496a-8b19-2764313ced69 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:03.323687 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-af428d45-2cfd-496a-8b19-2764313ced69 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:03.324805 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-af428d45-2cfd-496a-8b19-2764313ced69 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:03.325537 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-af428d45-2cfd-496a-8b19-2764313ced69 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:03.326172 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-af428d45-2cfd-496a-8b19-2764313ced69 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:03.458085 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-af428d45-2cfd-496a-8b19-2764313ced69 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:03.467182 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-af428d45-2cfd-496a-8b19-2764313ced69 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1674 microversion: 2.1 time: 0.161963 Sep 03 03:54:03.468065 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 352/705] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:03 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:03.657871 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-8711486e-9ee4-4e6f-8677-56793c7b8a17 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:03.658419 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-8711486e-9ee4-4e6f-8677-56793c7b8a17 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 4f5b827b-0905-4360-b0b5-f5881a029bc2] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:03.660809 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_api:SELECT=34 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:54:03.666361 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8711486e-9ee4-4e6f-8677-56793c7b8a17 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:03.666848 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8711486e-9ee4-4e6f-8677-56793c7b8a17 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:03.667308 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8711486e-9ee4-4e6f-8677-56793c7b8a17 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:03.668008 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8711486e-9ee4-4e6f-8677-56793c7b8a17 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:03.668459 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8711486e-9ee4-4e6f-8677-56793c7b8a17 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:03.668881 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8711486e-9ee4-4e6f-8677-56793c7b8a17 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:03.682647 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.wsgi [None req-8711486e-9ee4-4e6f-8677-56793c7b8a17 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] HTTP exception thrown: Instance 4f5b827b-0905-4360-b0b5-f5881a029bc2 could not be found. Sep 03 03:54:03.684609 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-8711486e-9ee4-4e6f-8677-56793c7b8a17 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Request method failure captured: Sep 03 03:54:03.684609 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: request: GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 HTTP/1.1 Sep 03 03:54:03.684609 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept: application/json Sep 03 03:54:03.684609 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept-Encoding: identity Sep 03 03:54:03.684609 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Connection: close Sep 03 03:54:03.684609 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Length: 0 Sep 03 03:54:03.684609 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Type: application/json Sep 03 03:54:03.684609 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Host: 10.222.0.25 Sep 03 03:54:03.684609 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Openstack-System-Scope: None Sep 03 03:54:03.684609 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: User-Agent: python-urllib3/1.26.12 Sep 03 03:54:03.684609 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Auth-Token: gAAAAABjEs66Kx8eeteMVyS4cMyfSkiyDGt_1eVtJar0jOqp2U5kldUKx2JCGXQO7DqE-XDheXtg2VZJo07feGC0TW1g6g8FkP9CZLuHpBInyfHfnQ4XyPTBmpEjfujwrAu0nW2aGLx5J777qnmGLgujnVhLN2AJ7Ilf6ZAuow1eLdAaB6k8vVw Sep 03 03:54:03.684609 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Id: None Sep 03 03:54:03.684609 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Name: None Sep 03 03:54:03.684609 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Identity-Status: Confirmed Sep 03 03:54:03.684609 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Is-Admin-Project: True Sep 03 03:54:03.684609 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Id: default Sep 03 03:54:03.684609 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Name: Default Sep 03 03:54:03.684609 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Id: f3077cfc588042e0a1becefe1363385c Sep 03 03:54:03.684609 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1521748712 Sep 03 03:54:03.684609 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Role: member,reader Sep 03 03:54:03.684609 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Roles: member,reader Sep 03 03:54:03.686256 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f3077cfc588042e0a1becefe1363385c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f3077cfc588042e0a1becefe1363385c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f3077cfc588042e0a1becefe1363385c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f3077cfc588042e0a1becefe1363385c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:54:03.686256 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1521748712 Sep 03 03:54:03.686256 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Id: f3077cfc588042e0a1becefe1363385c Sep 03 03:54:03.686256 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1521748712 Sep 03 03:54:03.686256 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User: tempest-ServerRescueNegativeTestJSON-1521748712-project Sep 03 03:54:03.686256 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Id: default Sep 03 03:54:03.686256 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Name: Default Sep 03 03:54:03.686256 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Id: ba00478a6ef74115b83726083026f574 Sep 03 03:54:03.686256 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1521748712-project Sep 03 03:54:03.686256 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: method: > Sep 03 03:54:03.686256 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: exception: Instance 4f5b827b-0905-4360-b0b5-f5881a029bc2 could not be found. Sep 03 03:54:03.686256 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: action_args: {'id': '4f5b827b-0905-4360-b0b5-f5881a029bc2'} Sep 03 03:54:03.687162 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:54:03.687162 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:54:03.687162 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 03:54:03.687162 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 03:54:03.687162 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 03:54:03.687162 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 03:54:03.687162 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 03:54:03.687162 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 03:54:03.687162 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 03:54:03.687162 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 03:54:03.687162 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f5b827b-0905-4360-b0b5-f5881a029bc2 could not be found. Sep 03 03:54:03.687162 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:54:03.687162 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:54:03.687162 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:54:03.687162 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:54:03.687162 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:54:03.687162 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:54:03.687162 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:54:03.687162 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:54:03.687162 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:54:03.688698 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:54:03.688698 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 03:54:03.688698 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 03:54:03.688698 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 03:54:03.688698 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 03:54:03.688698 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 03:54:03.688698 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:54:03.688698 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f5b827b-0905-4360-b0b5-f5881a029bc2 could not be found. Sep 03 03:54:03.688698 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:54:03.688698 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:54:03.688698 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:54:03.688698 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:54:03.688698 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:54:03.688698 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:54:03.688698 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:54:03.688698 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:54:03.688698 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f5b827b-0905-4360-b0b5-f5881a029bc2 could not be found. Sep 03 03:54:03.688698 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:54:03.690049 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-8711486e-9ee4-4e6f-8677-56793c7b8a17 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Returning 404 to user: Instance 4f5b827b-0905-4360-b0b5-f5881a029bc2 could not be found. {{(pid=132076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:54:03.690049 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-8711486e-9ee4-4e6f-8677-56793c7b8a17 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2" status: 404 len: 111 microversion: 2.1 time: 0.032238 Sep 03 03:54:03.690049 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 354/706] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:03 2022] GET /compute/v2.1/servers/4f5b827b-0905-4360-b0b5-f5881a029bc2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 03:54:03.699012 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-8d890e6e-c210-46b5-95a9-998ce5fd88f3 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '.version_select at 0x7f45fc58f550>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:03.720828 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-8d890e6e-c210-46b5-95a9-998ce5fd88f3 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-564165630" status: 202 len: 0 microversion: 2.1 time: 0.025878 Sep 03 03:54:03.721490 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 353/707] 10.222.0.25 () {58 vars in 1218 bytes} [Sat Sep 3 03:54:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-564165630 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 03:54:03.844661 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-266ad60a-5352-4556-8d39-172c0f163d1f req-95558a41-a7c4-4659-b643-3b7b2f07d125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "828bd786-6e99-4ccd-a4aa-9198ef8c8731", "name": "network-vif-deleted", "tag": "c131716e-c4cf-4300-99d4-32cea2b1becb"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:54:03.858021 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-266ad60a-5352-4556-8d39-172c0f163d1f req-95558a41-a7c4-4659-b643-3b7b2f07d125 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:03.858791 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-266ad60a-5352-4556-8d39-172c0f163d1f req-95558a41-a7c4-4659-b643-3b7b2f07d125 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:03.859653 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-266ad60a-5352-4556-8d39-172c0f163d1f req-95558a41-a7c4-4659-b643-3b7b2f07d125 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:03.873303 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-266ad60a-5352-4556-8d39-172c0f163d1f req-95558a41-a7c4-4659-b643-3b7b2f07d125 service nova] Creating event network-vif-deleted:c131716e-c4cf-4300-99d4-32cea2b1becb for instance 828bd786-6e99-4ccd-a4aa-9198ef8c8731 on hv-cinder-79966 Sep 03 03:54:03.878758 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-266ad60a-5352-4556-8d39-172c0f163d1f req-95558a41-a7c4-4659-b643-3b7b2f07d125 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038158 Sep 03 03:54:03.880234 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 355/708] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:54:04.494868 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-7a7a320b-b73c-4454-b56d-318d38a5689f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:04.495473 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-7a7a320b-b73c-4454-b56d-318d38a5689f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:04.523923 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7a7a320b-b73c-4454-b56d-318d38a5689f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:04.525004 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7a7a320b-b73c-4454-b56d-318d38a5689f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:04.525634 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7a7a320b-b73c-4454-b56d-318d38a5689f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:04.527339 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7a7a320b-b73c-4454-b56d-318d38a5689f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:04.529141 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7a7a320b-b73c-4454-b56d-318d38a5689f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:04.529747 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7a7a320b-b73c-4454-b56d-318d38a5689f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:04.571816 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7a7a320b-b73c-4454-b56d-318d38a5689f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:04.572302 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7a7a320b-b73c-4454-b56d-318d38a5689f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:04.572989 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7a7a320b-b73c-4454-b56d-318d38a5689f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:04.573434 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.objects.instance [None req-7a7a320b-b73c-4454-b56d-318d38a5689f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lazy-loading 'fault' on Instance uuid 828bd786-6e99-4ccd-a4aa-9198ef8c8731 {{(pid=132077) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 03:54:04.623813 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-7a7a320b-b73c-4454-b56d-318d38a5689f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:04.634204 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-7a7a320b-b73c-4454-b56d-318d38a5689f tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 200 len: 1328 microversion: 2.1 time: 0.146163 Sep 03 03:54:04.635271 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 354/709] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:04 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 1328 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:05.661477 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-42c01202-7a26-4377-830b-b70efbb15279 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:05.662604 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-42c01202-7a26-4377-830b-b70efbb15279 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:05.669971 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-42c01202-7a26-4377-830b-b70efbb15279 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:05.670483 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-42c01202-7a26-4377-830b-b70efbb15279 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:05.670994 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-42c01202-7a26-4377-830b-b70efbb15279 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:05.671656 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-42c01202-7a26-4377-830b-b70efbb15279 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:05.672110 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-42c01202-7a26-4377-830b-b70efbb15279 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:05.672526 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-42c01202-7a26-4377-830b-b70efbb15279 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:05.688642 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.wsgi [None req-42c01202-7a26-4377-830b-b70efbb15279 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] HTTP exception thrown: Instance 828bd786-6e99-4ccd-a4aa-9198ef8c8731 could not be found. Sep 03 03:54:05.690311 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-42c01202-7a26-4377-830b-b70efbb15279 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Request method failure captured: Sep 03 03:54:05.690311 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: request: GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 HTTP/1.1 Sep 03 03:54:05.690311 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept: application/json Sep 03 03:54:05.690311 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept-Encoding: identity Sep 03 03:54:05.690311 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Connection: close Sep 03 03:54:05.690311 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Length: 0 Sep 03 03:54:05.690311 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Type: application/json Sep 03 03:54:05.690311 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Host: 10.222.0.25 Sep 03 03:54:05.690311 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Openstack-System-Scope: None Sep 03 03:54:05.690311 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: User-Agent: python-urllib3/1.26.12 Sep 03 03:54:05.690311 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Auth-Token: gAAAAABjEs64h6RVIvypCuKugbvW3Y7YAUFh7VDm91768lXtoPaqdzXS-_Qkyi2f6kf4lWcyQskEslSa54oS5rrkvI6NoqAIJDoRzC5rEgPQNhr4ZiyVkcp4VnwUB_Yw3zT1bWPH1f6QhT2mQz0SvBXVUEG1SgHfD7qElRNuEWp7DrnjHzS2V-s Sep 03 03:54:05.690311 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Id: None Sep 03 03:54:05.690311 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Name: None Sep 03 03:54:05.690311 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Identity-Status: Confirmed Sep 03 03:54:05.690311 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Is-Admin-Project: True Sep 03 03:54:05.690311 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Id: default Sep 03 03:54:05.690311 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Name: Default Sep 03 03:54:05.690311 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Id: 12347de4d2e5465b9a00004084fcb85c Sep 03 03:54:05.690311 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Name: tempest-AttachVolumeTestJSON-1489543824 Sep 03 03:54:05.690311 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Role: member,reader Sep 03 03:54:05.690311 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Roles: member,reader Sep 03 03:54:05.691888 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12347de4d2e5465b9a00004084fcb85c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_12347de4d2e5465b9a00004084fcb85c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/12347de4d2e5465b9a00004084fcb85c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12347de4d2e5465b9a00004084fcb85c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:54:05.691888 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant: tempest-AttachVolumeTestJSON-1489543824 Sep 03 03:54:05.691888 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Id: 12347de4d2e5465b9a00004084fcb85c Sep 03 03:54:05.691888 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1489543824 Sep 03 03:54:05.691888 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User: tempest-AttachVolumeTestJSON-1489543824-project Sep 03 03:54:05.691888 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Id: default Sep 03 03:54:05.691888 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Name: Default Sep 03 03:54:05.691888 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Id: 58361634962b4b7884d51be90b683b42 Sep 03 03:54:05.691888 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Name: tempest-AttachVolumeTestJSON-1489543824-project Sep 03 03:54:05.691888 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: method: > Sep 03 03:54:05.691888 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: exception: Instance 828bd786-6e99-4ccd-a4aa-9198ef8c8731 could not be found. Sep 03 03:54:05.691888 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: action_args: {'id': '828bd786-6e99-4ccd-a4aa-9198ef8c8731'} Sep 03 03:54:05.692707 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:54:05.692707 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:54:05.692707 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 03:54:05.692707 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 03:54:05.692707 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 03:54:05.692707 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 03:54:05.692707 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 03:54:05.692707 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 03:54:05.692707 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 03:54:05.692707 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 03:54:05.692707 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 828bd786-6e99-4ccd-a4aa-9198ef8c8731 could not be found. Sep 03 03:54:05.692707 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:54:05.692707 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:54:05.692707 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:54:05.692707 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:54:05.692707 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:54:05.692707 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:54:05.692707 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:54:05.692707 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:54:05.692707 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:54:05.694034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:54:05.694034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 03:54:05.694034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 03:54:05.694034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 03:54:05.694034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 03:54:05.694034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 03:54:05.694034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:54:05.694034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 828bd786-6e99-4ccd-a4aa-9198ef8c8731 could not be found. Sep 03 03:54:05.694034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:54:05.694034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:54:05.694034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:54:05.694034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:54:05.694034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:54:05.694034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:54:05.694034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:54:05.694034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:54:05.694034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 828bd786-6e99-4ccd-a4aa-9198ef8c8731 could not be found. Sep 03 03:54:05.694034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:54:05.695159 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-42c01202-7a26-4377-830b-b70efbb15279 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Returning 404 to user: Instance 828bd786-6e99-4ccd-a4aa-9198ef8c8731 could not be found. {{(pid=132076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:54:05.695159 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-42c01202-7a26-4377-830b-b70efbb15279 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 404 len: 111 microversion: 2.1 time: 0.037129 Sep 03 03:54:05.695159 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 356/710] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:05 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 03:54:05.703658 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-c2c70113-4804-4f85-b07b-fc628cf7beca tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '.version_select at 0x7f45fc5a4dc0>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:05.724517 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-c2c70113-4804-4f85-b07b-fc628cf7beca tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2086629987" status: 202 len: 0 microversion: 2.1 time: 0.024706 Sep 03 03:54:05.725104 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 355/711] 10.222.0.25 () {58 vars in 1221 bytes} [Sat Sep 3 03:54:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2086629987 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 03:54:06.386915 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-be1efcb9-f2c0-48bf-ae74-2b71a4ec0ed6 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Action: 'create', calling method: .version_select at 0x7f45fc598c10>, body: {"keypair": {"name": "tempest-keypair-153976151", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLNe7suCdUTIFp+KhSn1MjRykz8Mpt0VgqTMi52zuAw71qCFS2YaOKUrk/1i02G0AB0DjQ1uzXTb6uDi53+Sj+QY6v4iAvpPbzN9k/xsXQ1GIaeo7/4V5cnnx5FB92UR2Q=="}} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:54:06.402900 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.quota [None req-be1efcb9-f2c0-48bf-ae74-2b71a4ec0ed6 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Getting quotas for project 12347de4d2e5465b9a00004084fcb85c. Resources: {'key_pairs'} {{(pid=132076) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 03:54:06.406777 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.quota [None req-be1efcb9-f2c0-48bf-ae74-2b71a4ec0ed6 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Getting quotas for user 58361634962b4b7884d51be90b683b42 and project 12347de4d2e5465b9a00004084fcb85c. Resources: {'key_pairs'} {{(pid=132076) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 03:54:06.430414 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-be1efcb9-f2c0-48bf-ae74-2b71a4ec0ed6 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047616 Sep 03 03:54:06.431019 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 357/712] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Sep 3 03:54:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:54:06.741487 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-47983f0d-18cf-4422-ae5c-44dd643c0ccb tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:06.742114 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-47983f0d-18cf-4422-ae5c-44dd643c0ccb tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:06.748593 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-47983f0d-18cf-4422-ae5c-44dd643c0ccb tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:06.749083 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-47983f0d-18cf-4422-ae5c-44dd643c0ccb tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:06.749527 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-47983f0d-18cf-4422-ae5c-44dd643c0ccb tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:06.750290 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-47983f0d-18cf-4422-ae5c-44dd643c0ccb tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:06.750898 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-47983f0d-18cf-4422-ae5c-44dd643c0ccb tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:06.751330 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-47983f0d-18cf-4422-ae5c-44dd643c0ccb tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:06.779142 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-47983f0d-18cf-4422-ae5c-44dd643c0ccb tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Going to try to terminate instance {{(pid=132077) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 03:54:06.860747 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-47983f0d-18cf-4422-ae5c-44dd643c0ccb tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 204 len: 0 microversion: 2.1 time: 0.123381 Sep 03 03:54:06.861690 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 356/713] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Sep 3 03:54:06 2022] DELETE /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 03:54:06.870653 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-f79e2e16-7861-4dba-8d55-47266ff1af84 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:06.871977 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-f79e2e16-7861-4dba-8d55-47266ff1af84 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:06.879986 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f79e2e16-7861-4dba-8d55-47266ff1af84 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:06.880307 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f79e2e16-7861-4dba-8d55-47266ff1af84 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:06.880765 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f79e2e16-7861-4dba-8d55-47266ff1af84 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:06.881706 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f79e2e16-7861-4dba-8d55-47266ff1af84 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:06.882130 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f79e2e16-7861-4dba-8d55-47266ff1af84 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:06.882584 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f79e2e16-7861-4dba-8d55-47266ff1af84 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:07.014512 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-f79e2e16-7861-4dba-8d55-47266ff1af84 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:07.022525 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-f79e2e16-7861-4dba-8d55-47266ff1af84 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1507 microversion: 2.1 time: 0.156591 Sep 03 03:54:07.023144 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 358/714] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:06 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:07.752630 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-2bba331e-f02d-4a59-af8b-2a8291f2a6e7 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2029021840", "imageRef": "0af209bb-870a-4343-a9f9-de05883bb8dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "335e6c24-2920-465c-b2cd-3b3be68e2751"}], "security_groups": [{"name": "tempest-securitygroup--1730028333"}], "key_name": "tempest-keypair-153976151", "user_data": "}} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:54:07.861905 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.network.neutron [None req-2bba331e-f02d-4a59-af8b-2a8291f2a6e7 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] validate_networks() for [('335e6c24-2920-465c-b2cd-3b3be68e2751', None, None, None, None, None)] {{(pid=132077) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 03:54:08.046049 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-72553f98-f1a0-4018-807e-0814f9439cb0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:08.046589 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-72553f98-f1a0-4018-807e-0814f9439cb0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:08.052959 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-72553f98-f1a0-4018-807e-0814f9439cb0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:08.053469 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-72553f98-f1a0-4018-807e-0814f9439cb0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:08.053904 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-72553f98-f1a0-4018-807e-0814f9439cb0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:08.054601 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-72553f98-f1a0-4018-807e-0814f9439cb0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:08.055182 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-72553f98-f1a0-4018-807e-0814f9439cb0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:08.055534 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-72553f98-f1a0-4018-807e-0814f9439cb0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:08.058268 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=1 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:54:08.184497 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-72553f98-f1a0-4018-807e-0814f9439cb0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:08.192563 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-72553f98-f1a0-4018-807e-0814f9439cb0 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1507 microversion: 2.1 time: 0.150471 Sep 03 03:54:08.193127 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 359/715] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:08 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:08.247968 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-2bba331e-f02d-4a59-af8b-2a8291f2a6e7 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Flavor limits 0:0:0 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 03:54:08.248415 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-2bba331e-f02d-4a59-af8b-2a8291f2a6e7 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Image limits 0:0:0 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 03:54:08.248880 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-2bba331e-f02d-4a59-af8b-2a8291f2a6e7 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Flavor pref 0:0:0 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 03:54:08.249280 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-2bba331e-f02d-4a59-af8b-2a8291f2a6e7 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Image pref 0:0:0 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 03:54:08.249685 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-2bba331e-f02d-4a59-af8b-2a8291f2a6e7 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 03:54:08.258927 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2bba331e-f02d-4a59-af8b-2a8291f2a6e7 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:08.259405 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2bba331e-f02d-4a59-af8b-2a8291f2a6e7 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:08.259838 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2bba331e-f02d-4a59-af8b-2a8291f2a6e7 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:08.260563 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2bba331e-f02d-4a59-af8b-2a8291f2a6e7 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:08.261016 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2bba331e-f02d-4a59-af8b-2a8291f2a6e7 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:08.261437 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2bba331e-f02d-4a59-af8b-2a8291f2a6e7 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:08.278175 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.quota [None req-2bba331e-f02d-4a59-af8b-2a8291f2a6e7 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Getting quotas for project 12347de4d2e5465b9a00004084fcb85c. Resources: {'ram', 'instances', 'cores'} {{(pid=132077) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 03:54:08.282454 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.quota [None req-2bba331e-f02d-4a59-af8b-2a8291f2a6e7 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Getting quotas for user 58361634962b4b7884d51be90b683b42 and project 12347de4d2e5465b9a00004084fcb85c. Resources: {'ram', 'instances', 'cores'} {{(pid=132077) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 03:54:08.294013 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-2bba331e-f02d-4a59-af8b-2a8291f2a6e7 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Going to run 1 instances... {{(pid=132077) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 03:54:08.296479 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-2bba331e-f02d-4a59-af8b-2a8291f2a6e7 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 3d5f7818-14ce-4b6d-b040-6924c777d0d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0af209bb-870a-4343-a9f9-de05883bb8dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132077) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 03:54:08.346076 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-2bba331e-f02d-4a59-af8b-2a8291f2a6e7 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.597939 Sep 03 03:54:08.346685 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 357/716] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Sep 3 03:54:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 03:54:08.358475 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-b2094127-7490-48b0-8dbf-d68c0ecb012d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:08.359118 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-b2094127-7490-48b0-8dbf-d68c0ecb012d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 3d5f7818-14ce-4b6d-b040-6924c777d0d0] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:08.416636 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-b2094127-7490-48b0-8dbf-d68c0ecb012d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:08.423563 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-b2094127-7490-48b0-8dbf-d68c0ecb012d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0" status: 200 len: 1237 microversion: 2.1 time: 0.069393 Sep 03 03:54:08.424129 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 360/717] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:08 2022] GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0 => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:09.215570 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-2ba98d60-cedc-45b9-95d3-2dc8c2e4bd39 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:09.216128 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-2ba98d60-cedc-45b9-95d3-2dc8c2e4bd39 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:09.223402 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2ba98d60-cedc-45b9-95d3-2dc8c2e4bd39 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:09.223899 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2ba98d60-cedc-45b9-95d3-2dc8c2e4bd39 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:09.224327 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2ba98d60-cedc-45b9-95d3-2dc8c2e4bd39 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:09.225032 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2ba98d60-cedc-45b9-95d3-2dc8c2e4bd39 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:09.225467 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2ba98d60-cedc-45b9-95d3-2dc8c2e4bd39 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:09.225915 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2ba98d60-cedc-45b9-95d3-2dc8c2e4bd39 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:09.373869 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-2ba98d60-cedc-45b9-95d3-2dc8c2e4bd39 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:09.382833 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-2ba98d60-cedc-45b9-95d3-2dc8c2e4bd39 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1507 microversion: 2.1 time: 0.171103 Sep 03 03:54:09.389235 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 358/718] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:09 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1507 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:09.446043 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-55631054-cec4-4b1b-a800-ee84ab5b3c33 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:09.446650 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-55631054-cec4-4b1b-a800-ee84ab5b3c33 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 3d5f7818-14ce-4b6d-b040-6924c777d0d0] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:09.454031 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-55631054-cec4-4b1b-a800-ee84ab5b3c33 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:09.454551 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-55631054-cec4-4b1b-a800-ee84ab5b3c33 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:09.455014 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-55631054-cec4-4b1b-a800-ee84ab5b3c33 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:09.455727 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-55631054-cec4-4b1b-a800-ee84ab5b3c33 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:09.456164 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-55631054-cec4-4b1b-a800-ee84ab5b3c33 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:09.456584 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-55631054-cec4-4b1b-a800-ee84ab5b3c33 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:09.542188 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-55631054-cec4-4b1b-a800-ee84ab5b3c33 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:09.550043 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-55631054-cec4-4b1b-a800-ee84ab5b3c33 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0" status: 200 len: 1289 microversion: 2.1 time: 0.108320 Sep 03 03:54:09.550611 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 361/719] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:09 2022] GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0 => generated 1289 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:09.732079 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-d710415b-2001-41a9-9016-4ecb485aace3 req-daafd642-5165-4329-8afa-195bef73c849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ab059eb-4353-4c86-91ae-089e1c35f387", "name": "network-vif-deleted", "tag": "1dd4dd3b-d3d8-41d5-bd57-76720a2443c2"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:54:09.742400 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-d710415b-2001-41a9-9016-4ecb485aace3 req-daafd642-5165-4329-8afa-195bef73c849 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:09.743544 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-d710415b-2001-41a9-9016-4ecb485aace3 req-daafd642-5165-4329-8afa-195bef73c849 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:09.744320 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-d710415b-2001-41a9-9016-4ecb485aace3 req-daafd642-5165-4329-8afa-195bef73c849 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:09.759025 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-d710415b-2001-41a9-9016-4ecb485aace3 req-daafd642-5165-4329-8afa-195bef73c849 service nova] Creating event network-vif-deleted:1dd4dd3b-d3d8-41d5-bd57-76720a2443c2 for instance 5ab059eb-4353-4c86-91ae-089e1c35f387 on hv-cinder-79966 Sep 03 03:54:09.765678 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-d710415b-2001-41a9-9016-4ecb485aace3 req-daafd642-5165-4329-8afa-195bef73c849 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037280 Sep 03 03:54:09.767042 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 359/720] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:54:10.405763 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-4515f8c7-f9e2-42f7-87e3-04bf5045c23d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:10.406470 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-4515f8c7-f9e2-42f7-87e3-04bf5045c23d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:10.412703 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4515f8c7-f9e2-42f7-87e3-04bf5045c23d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:10.413190 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4515f8c7-f9e2-42f7-87e3-04bf5045c23d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:10.413647 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4515f8c7-f9e2-42f7-87e3-04bf5045c23d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:10.414555 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4515f8c7-f9e2-42f7-87e3-04bf5045c23d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:10.415048 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4515f8c7-f9e2-42f7-87e3-04bf5045c23d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:10.415464 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4515f8c7-f9e2-42f7-87e3-04bf5045c23d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:10.451327 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4515f8c7-f9e2-42f7-87e3-04bf5045c23d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:10.451994 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4515f8c7-f9e2-42f7-87e3-04bf5045c23d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:10.452203 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4515f8c7-f9e2-42f7-87e3-04bf5045c23d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:10.452660 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.objects.instance [None req-4515f8c7-f9e2-42f7-87e3-04bf5045c23d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lazy-loading 'fault' on Instance uuid 5ab059eb-4353-4c86-91ae-089e1c35f387 {{(pid=132076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 03:54:10.520374 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-4515f8c7-f9e2-42f7-87e3-04bf5045c23d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:10.537747 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-4515f8c7-f9e2-42f7-87e3-04bf5045c23d tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 200 len: 1311 microversion: 2.1 time: 0.135849 Sep 03 03:54:10.539290 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 362/721] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:10 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 1311 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:10.576966 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-42a91620-4251-4936-9147-9ef80d0fbc1c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:10.579139 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-42a91620-4251-4936-9147-9ef80d0fbc1c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 3d5f7818-14ce-4b6d-b040-6924c777d0d0] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:10.592961 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-42a91620-4251-4936-9147-9ef80d0fbc1c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:10.595623 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-42a91620-4251-4936-9147-9ef80d0fbc1c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:10.596725 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-42a91620-4251-4936-9147-9ef80d0fbc1c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:10.597726 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-42a91620-4251-4936-9147-9ef80d0fbc1c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:10.598793 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-42a91620-4251-4936-9147-9ef80d0fbc1c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:10.599237 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-42a91620-4251-4936-9147-9ef80d0fbc1c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:10.747983 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-42a91620-4251-4936-9147-9ef80d0fbc1c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:10.755709 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-42a91620-4251-4936-9147-9ef80d0fbc1c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0" status: 200 len: 1363 microversion: 2.1 time: 0.185454 Sep 03 03:54:10.756338 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 360/722] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:10 2022] GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:11.561712 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-3ab4a32a-fc13-4aec-9290-4f41618c1dd9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:11.562390 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-3ab4a32a-fc13-4aec-9290-4f41618c1dd9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: 5ab059eb-4353-4c86-91ae-089e1c35f387] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:11.569964 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3ab4a32a-fc13-4aec-9290-4f41618c1dd9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:11.570451 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3ab4a32a-fc13-4aec-9290-4f41618c1dd9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:11.570883 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3ab4a32a-fc13-4aec-9290-4f41618c1dd9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:11.571599 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3ab4a32a-fc13-4aec-9290-4f41618c1dd9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:11.572038 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3ab4a32a-fc13-4aec-9290-4f41618c1dd9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:11.572513 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3ab4a32a-fc13-4aec-9290-4f41618c1dd9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:11.587180 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.wsgi [None req-3ab4a32a-fc13-4aec-9290-4f41618c1dd9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] HTTP exception thrown: Instance 5ab059eb-4353-4c86-91ae-089e1c35f387 could not be found. Sep 03 03:54:11.588756 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-3ab4a32a-fc13-4aec-9290-4f41618c1dd9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Request method failure captured: Sep 03 03:54:11.588756 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: request: GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 HTTP/1.1 Sep 03 03:54:11.588756 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept: application/json Sep 03 03:54:11.588756 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept-Encoding: identity Sep 03 03:54:11.588756 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Connection: close Sep 03 03:54:11.588756 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Length: 0 Sep 03 03:54:11.588756 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Type: application/json Sep 03 03:54:11.588756 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Host: 10.222.0.25 Sep 03 03:54:11.588756 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Openstack-System-Scope: None Sep 03 03:54:11.588756 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: User-Agent: python-urllib3/1.26.12 Sep 03 03:54:11.588756 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Auth-Token: gAAAAABjEs66Kx8eeteMVyS4cMyfSkiyDGt_1eVtJar0jOqp2U5kldUKx2JCGXQO7DqE-XDheXtg2VZJo07feGC0TW1g6g8FkP9CZLuHpBInyfHfnQ4XyPTBmpEjfujwrAu0nW2aGLx5J777qnmGLgujnVhLN2AJ7Ilf6ZAuow1eLdAaB6k8vVw Sep 03 03:54:11.588756 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Id: None Sep 03 03:54:11.588756 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Name: None Sep 03 03:54:11.588756 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Identity-Status: Confirmed Sep 03 03:54:11.588756 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Is-Admin-Project: True Sep 03 03:54:11.588756 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Id: default Sep 03 03:54:11.588756 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Name: Default Sep 03 03:54:11.588756 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Id: f3077cfc588042e0a1becefe1363385c Sep 03 03:54:11.588756 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1521748712 Sep 03 03:54:11.588756 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Role: member,reader Sep 03 03:54:11.588756 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Roles: member,reader Sep 03 03:54:11.590265 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f3077cfc588042e0a1becefe1363385c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f3077cfc588042e0a1becefe1363385c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f3077cfc588042e0a1becefe1363385c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f3077cfc588042e0a1becefe1363385c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:54:11.590265 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1521748712 Sep 03 03:54:11.590265 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Id: f3077cfc588042e0a1becefe1363385c Sep 03 03:54:11.590265 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1521748712 Sep 03 03:54:11.590265 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User: tempest-ServerRescueNegativeTestJSON-1521748712-project Sep 03 03:54:11.590265 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Id: default Sep 03 03:54:11.590265 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Name: Default Sep 03 03:54:11.590265 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Id: ba00478a6ef74115b83726083026f574 Sep 03 03:54:11.590265 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1521748712-project Sep 03 03:54:11.590265 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: method: > Sep 03 03:54:11.590265 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: exception: Instance 5ab059eb-4353-4c86-91ae-089e1c35f387 could not be found. Sep 03 03:54:11.590265 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: action_args: {'id': '5ab059eb-4353-4c86-91ae-089e1c35f387'} Sep 03 03:54:11.591061 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:54:11.591061 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:54:11.591061 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 03:54:11.591061 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 03:54:11.591061 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 03:54:11.591061 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 03:54:11.591061 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 03:54:11.591061 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 03:54:11.591061 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 03:54:11.591061 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 03:54:11.591061 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ab059eb-4353-4c86-91ae-089e1c35f387 could not be found. Sep 03 03:54:11.591061 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:54:11.591061 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:54:11.591061 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:54:11.591061 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:54:11.591061 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:54:11.591061 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:54:11.591061 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:54:11.591061 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:54:11.591061 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:54:11.592523 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:54:11.592523 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 03:54:11.592523 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 03:54:11.592523 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 03:54:11.592523 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 03:54:11.592523 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 03:54:11.592523 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:54:11.592523 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ab059eb-4353-4c86-91ae-089e1c35f387 could not be found. Sep 03 03:54:11.592523 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:54:11.592523 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:54:11.592523 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:54:11.592523 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:54:11.592523 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:54:11.592523 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:54:11.592523 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:54:11.592523 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:54:11.592523 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ab059eb-4353-4c86-91ae-089e1c35f387 could not be found. Sep 03 03:54:11.592523 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:54:11.593751 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-3ab4a32a-fc13-4aec-9290-4f41618c1dd9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Returning 404 to user: Instance 5ab059eb-4353-4c86-91ae-089e1c35f387 could not be found. {{(pid=132076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:54:11.593751 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-3ab4a32a-fc13-4aec-9290-4f41618c1dd9 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387" status: 404 len: 111 microversion: 2.1 time: 0.032370 Sep 03 03:54:11.593751 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 363/723] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:11 2022] GET /compute/v2.1/servers/5ab059eb-4353-4c86-91ae-089e1c35f387 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 03:54:11.598824 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-3917519c-28e8-4b72-8f51-56218b7a4b71 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:11.599318 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-3917519c-28e8-4b72-8f51-56218b7a4b71 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: f7f92467-64ec-4eba-af52-ad4923543504] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:11.605824 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3917519c-28e8-4b72-8f51-56218b7a4b71 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:11.606292 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3917519c-28e8-4b72-8f51-56218b7a4b71 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:11.607094 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3917519c-28e8-4b72-8f51-56218b7a4b71 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:11.607811 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3917519c-28e8-4b72-8f51-56218b7a4b71 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:11.608251 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3917519c-28e8-4b72-8f51-56218b7a4b71 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:11.608662 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3917519c-28e8-4b72-8f51-56218b7a4b71 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:11.634183 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-3917519c-28e8-4b72-8f51-56218b7a4b71 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: f7f92467-64ec-4eba-af52-ad4923543504] Going to try to terminate instance {{(pid=132077) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 03:54:11.648998 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:54:11.718920 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-3917519c-28e8-4b72-8f51-56218b7a4b71 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504" status: 204 len: 0 microversion: 2.1 time: 0.123567 Sep 03 03:54:11.720004 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 361/724] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Sep 3 03:54:11 2022] DELETE /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 03 03:54:11.728469 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-09ef1e36-40fa-4df4-bd99-cca965297c14 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:11.729792 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-09ef1e36-40fa-4df4-bd99-cca965297c14 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: f7f92467-64ec-4eba-af52-ad4923543504] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:11.736904 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-09ef1e36-40fa-4df4-bd99-cca965297c14 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:11.737401 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-09ef1e36-40fa-4df4-bd99-cca965297c14 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:11.737967 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-09ef1e36-40fa-4df4-bd99-cca965297c14 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:11.738660 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-09ef1e36-40fa-4df4-bd99-cca965297c14 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:11.739205 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-09ef1e36-40fa-4df4-bd99-cca965297c14 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:11.739616 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-09ef1e36-40fa-4df4-bd99-cca965297c14 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:11.779464 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-d449067e-503b-4c45-bda9-fcee780a9bb5 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:11.780155 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-d449067e-503b-4c45-bda9-fcee780a9bb5 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 3d5f7818-14ce-4b6d-b040-6924c777d0d0] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:11.787027 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d449067e-503b-4c45-bda9-fcee780a9bb5 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:11.787648 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d449067e-503b-4c45-bda9-fcee780a9bb5 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:11.787914 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d449067e-503b-4c45-bda9-fcee780a9bb5 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:11.788597 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d449067e-503b-4c45-bda9-fcee780a9bb5 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:11.789036 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d449067e-503b-4c45-bda9-fcee780a9bb5 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:11.789447 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d449067e-503b-4c45-bda9-fcee780a9bb5 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:11.881505 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-09ef1e36-40fa-4df4-bd99-cca965297c14 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:11.889054 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-09ef1e36-40fa-4df4-bd99-cca965297c14 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504" status: 200 len: 1522 microversion: 2.1 time: 0.164920 Sep 03 03:54:11.889609 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 364/725] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:11 2022] GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:11.894116 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-0374ffd3-d662-4220-8c0f-cefd2b5cf0f1 req-428db6e4-f89c-40c5-ab24-e89a172ce51c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d5f7818-14ce-4b6d-b040-6924c777d0d0", "tag": "8bd4fb48-65f5-4f59-8039-923cd37f3c8d"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:54:11.903176 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-0374ffd3-d662-4220-8c0f-cefd2b5cf0f1 req-428db6e4-f89c-40c5-ab24-e89a172ce51c service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:11.903657 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-0374ffd3-d662-4220-8c0f-cefd2b5cf0f1 req-428db6e4-f89c-40c5-ab24-e89a172ce51c service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:11.904067 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-0374ffd3-d662-4220-8c0f-cefd2b5cf0f1 req-428db6e4-f89c-40c5-ab24-e89a172ce51c service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:11.914987 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-0374ffd3-d662-4220-8c0f-cefd2b5cf0f1 req-428db6e4-f89c-40c5-ab24-e89a172ce51c service nova] Creating event network-changed:8bd4fb48-65f5-4f59-8039-923cd37f3c8d for instance 3d5f7818-14ce-4b6d-b040-6924c777d0d0 on hv-cinder-79966 Sep 03 03:54:11.919855 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-0374ffd3-d662-4220-8c0f-cefd2b5cf0f1 req-428db6e4-f89c-40c5-ab24-e89a172ce51c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028978 Sep 03 03:54:11.920442 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 365/726] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:54:11.920884 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-d449067e-503b-4c45-bda9-fcee780a9bb5 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:11.929041 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-d449067e-503b-4c45-bda9-fcee780a9bb5 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0" status: 200 len: 1363 microversion: 2.1 time: 0.153806 Sep 03 03:54:11.929610 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 362/727] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:11 2022] GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:54:12.916992 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-69c6914c-b4f6-4750-bd1f-829cc50fae9c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:12.918002 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-69c6914c-b4f6-4750-bd1f-829cc50fae9c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: f7f92467-64ec-4eba-af52-ad4923543504] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:12.926904 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-69c6914c-b4f6-4750-bd1f-829cc50fae9c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:12.927226 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-69c6914c-b4f6-4750-bd1f-829cc50fae9c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:12.927655 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-69c6914c-b4f6-4750-bd1f-829cc50fae9c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:12.928340 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-69c6914c-b4f6-4750-bd1f-829cc50fae9c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:12.928767 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-69c6914c-b4f6-4750-bd1f-829cc50fae9c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:12.929178 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-69c6914c-b4f6-4750-bd1f-829cc50fae9c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:12.952487 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-5d3c48d2-9cd0-4390-8143-c4768cbe3552 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:12.953219 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-5d3c48d2-9cd0-4390-8143-c4768cbe3552 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 3d5f7818-14ce-4b6d-b040-6924c777d0d0] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:12.960229 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5d3c48d2-9cd0-4390-8143-c4768cbe3552 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:12.960714 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5d3c48d2-9cd0-4390-8143-c4768cbe3552 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:12.961145 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5d3c48d2-9cd0-4390-8143-c4768cbe3552 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:12.961874 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5d3c48d2-9cd0-4390-8143-c4768cbe3552 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:12.962297 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5d3c48d2-9cd0-4390-8143-c4768cbe3552 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:12.962721 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5d3c48d2-9cd0-4390-8143-c4768cbe3552 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:13.062579 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-69c6914c-b4f6-4750-bd1f-829cc50fae9c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:13.070542 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-69c6914c-b4f6-4750-bd1f-829cc50fae9c tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504" status: 200 len: 1522 microversion: 2.1 time: 0.160681 Sep 03 03:54:13.071149 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 366/728] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:12 2022] GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:13.094937 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-5d3c48d2-9cd0-4390-8143-c4768cbe3552 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:13.102554 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-5d3c48d2-9cd0-4390-8143-c4768cbe3552 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0" status: 200 len: 1363 microversion: 2.1 time: 0.153921 Sep 03 03:54:13.103141 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 363/729] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:12 2022] GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:14.096361 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-15143647-05b2-4e16-afec-4bfd907369ff tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:14.097213 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-15143647-05b2-4e16-afec-4bfd907369ff tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: f7f92467-64ec-4eba-af52-ad4923543504] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:14.105968 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-15143647-05b2-4e16-afec-4bfd907369ff tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:14.107046 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-15143647-05b2-4e16-afec-4bfd907369ff tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:14.107622 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-15143647-05b2-4e16-afec-4bfd907369ff tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:14.108591 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-15143647-05b2-4e16-afec-4bfd907369ff tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:14.109191 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-15143647-05b2-4e16-afec-4bfd907369ff tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:14.109752 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-15143647-05b2-4e16-afec-4bfd907369ff tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:14.183247 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-ed6529b7-cabe-4510-ab2d-25d012926f17 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:14.183858 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-ed6529b7-cabe-4510-ab2d-25d012926f17 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 3d5f7818-14ce-4b6d-b040-6924c777d0d0] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:14.190413 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ed6529b7-cabe-4510-ab2d-25d012926f17 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:14.190932 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ed6529b7-cabe-4510-ab2d-25d012926f17 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:14.191365 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ed6529b7-cabe-4510-ab2d-25d012926f17 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:14.192110 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ed6529b7-cabe-4510-ab2d-25d012926f17 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:14.192510 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ed6529b7-cabe-4510-ab2d-25d012926f17 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:14.193001 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ed6529b7-cabe-4510-ab2d-25d012926f17 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:14.257955 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-15143647-05b2-4e16-afec-4bfd907369ff tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:14.273543 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-15143647-05b2-4e16-afec-4bfd907369ff tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504" status: 200 len: 1522 microversion: 2.1 time: 0.183222 Sep 03 03:54:14.274115 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 367/730] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:14 2022] GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:14.334427 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-ed6529b7-cabe-4510-ab2d-25d012926f17 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:14.344376 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-ed6529b7-cabe-4510-ab2d-25d012926f17 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0" status: 200 len: 1363 microversion: 2.1 time: 0.221879 Sep 03 03:54:14.345249 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 364/731] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:14 2022] GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0 => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:15.367960 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-37841a1e-e1f4-4b2b-89b2-18ef169e88df tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:15.368659 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-37841a1e-e1f4-4b2b-89b2-18ef169e88df tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 3d5f7818-14ce-4b6d-b040-6924c777d0d0] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:15.375321 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-37841a1e-e1f4-4b2b-89b2-18ef169e88df tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:15.375793 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-37841a1e-e1f4-4b2b-89b2-18ef169e88df tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:15.376215 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-37841a1e-e1f4-4b2b-89b2-18ef169e88df tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:15.376923 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-37841a1e-e1f4-4b2b-89b2-18ef169e88df tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:15.377367 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-37841a1e-e1f4-4b2b-89b2-18ef169e88df tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:15.377783 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-37841a1e-e1f4-4b2b-89b2-18ef169e88df tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:15.410464 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-0f467eda-3506-417e-8632-b9376942ce23 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:15.411088 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-0f467eda-3506-417e-8632-b9376942ce23 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: f7f92467-64ec-4eba-af52-ad4923543504] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:15.417748 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0f467eda-3506-417e-8632-b9376942ce23 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:15.418217 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0f467eda-3506-417e-8632-b9376942ce23 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:15.418648 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0f467eda-3506-417e-8632-b9376942ce23 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:15.419378 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0f467eda-3506-417e-8632-b9376942ce23 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:15.419808 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0f467eda-3506-417e-8632-b9376942ce23 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:15.420191 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0f467eda-3506-417e-8632-b9376942ce23 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:15.514468 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-37841a1e-e1f4-4b2b-89b2-18ef169e88df tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:15.522783 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-37841a1e-e1f4-4b2b-89b2-18ef169e88df tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0" status: 200 len: 1363 microversion: 2.1 time: 0.158770 Sep 03 03:54:15.523404 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 365/732] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:15 2022] GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:54:15.556789 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-0f467eda-3506-417e-8632-b9376942ce23 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:15.564851 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-0f467eda-3506-417e-8632-b9376942ce23 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504" status: 200 len: 1522 microversion: 2.1 time: 0.271520 Sep 03 03:54:15.565466 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 368/733] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:15 2022] GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:16.545989 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-eb9542d7-e60e-4d04-b9f0-cce5286a878c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:16.546590 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-eb9542d7-e60e-4d04-b9f0-cce5286a878c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 3d5f7818-14ce-4b6d-b040-6924c777d0d0] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:16.553005 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eb9542d7-e60e-4d04-b9f0-cce5286a878c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:16.553670 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eb9542d7-e60e-4d04-b9f0-cce5286a878c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:16.554200 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eb9542d7-e60e-4d04-b9f0-cce5286a878c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:16.555209 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eb9542d7-e60e-4d04-b9f0-cce5286a878c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:16.556285 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eb9542d7-e60e-4d04-b9f0-cce5286a878c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:16.556807 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eb9542d7-e60e-4d04-b9f0-cce5286a878c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:16.588816 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-8d0fe3b8-4201-412e-a4dc-c7a9885a0634 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:16.589910 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-8d0fe3b8-4201-412e-a4dc-c7a9885a0634 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: f7f92467-64ec-4eba-af52-ad4923543504] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:16.600349 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8d0fe3b8-4201-412e-a4dc-c7a9885a0634 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:16.601139 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8d0fe3b8-4201-412e-a4dc-c7a9885a0634 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:16.601558 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8d0fe3b8-4201-412e-a4dc-c7a9885a0634 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:16.602294 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8d0fe3b8-4201-412e-a4dc-c7a9885a0634 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:16.602990 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8d0fe3b8-4201-412e-a4dc-c7a9885a0634 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:16.604889 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8d0fe3b8-4201-412e-a4dc-c7a9885a0634 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:16.702416 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-8d0fe3b8-4201-412e-a4dc-c7a9885a0634 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba00478a6ef74115b83726083026f574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3077cfc588042e0a1becefe1363385c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:16.712800 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-8d0fe3b8-4201-412e-a4dc-c7a9885a0634 tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504" status: 200 len: 1480 microversion: 2.1 time: 0.127955 Sep 03 03:54:16.714036 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 369/734] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:16 2022] GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504 => generated 1480 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:16.737418 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-421a9660-693a-44d6-afb7-2f113f67d2ac req-d9c453a1-6d4a-4ee8-8829-fb55d93b706b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f92467-64ec-4eba-af52-ad4923543504", "name": "network-vif-deleted", "tag": "41a7b1ba-2a3f-4b4f-8d13-1e07765177c0"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:54:16.756445 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-421a9660-693a-44d6-afb7-2f113f67d2ac req-d9c453a1-6d4a-4ee8-8829-fb55d93b706b service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:16.760875 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-421a9660-693a-44d6-afb7-2f113f67d2ac req-d9c453a1-6d4a-4ee8-8829-fb55d93b706b service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:16.761616 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-421a9660-693a-44d6-afb7-2f113f67d2ac req-d9c453a1-6d4a-4ee8-8829-fb55d93b706b service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:16.775217 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-eb9542d7-e60e-4d04-b9f0-cce5286a878c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:16.784656 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-eb9542d7-e60e-4d04-b9f0-cce5286a878c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0" status: 200 len: 1363 microversion: 2.1 time: 0.242461 Sep 03 03:54:16.789679 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-421a9660-693a-44d6-afb7-2f113f67d2ac req-d9c453a1-6d4a-4ee8-8829-fb55d93b706b service nova] Creating event network-vif-deleted:41a7b1ba-2a3f-4b4f-8d13-1e07765177c0 for instance f7f92467-64ec-4eba-af52-ad4923543504 on hv-cinder-79966 Sep 03 03:54:16.797282 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 366/735] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:16 2022] GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0 => generated 1363 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:16.799516 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-421a9660-693a-44d6-afb7-2f113f67d2ac req-d9c453a1-6d4a-4ee8-8829-fb55d93b706b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083963 Sep 03 03:54:16.800334 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 370/736] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:54:17.743997 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-39a57cff-25fa-4bb3-b2a3-fbb5cff1dc7e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:17.745019 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-39a57cff-25fa-4bb3-b2a3-fbb5cff1dc7e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] [instance: f7f92467-64ec-4eba-af52-ad4923543504] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:17.754643 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-39a57cff-25fa-4bb3-b2a3-fbb5cff1dc7e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:17.755143 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-39a57cff-25fa-4bb3-b2a3-fbb5cff1dc7e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:17.755567 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-39a57cff-25fa-4bb3-b2a3-fbb5cff1dc7e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:17.756258 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-39a57cff-25fa-4bb3-b2a3-fbb5cff1dc7e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:17.756703 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-39a57cff-25fa-4bb3-b2a3-fbb5cff1dc7e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:17.757113 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-39a57cff-25fa-4bb3-b2a3-fbb5cff1dc7e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:17.770943 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.wsgi [None req-39a57cff-25fa-4bb3-b2a3-fbb5cff1dc7e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] HTTP exception thrown: Instance f7f92467-64ec-4eba-af52-ad4923543504 could not be found. Sep 03 03:54:17.772589 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-39a57cff-25fa-4bb3-b2a3-fbb5cff1dc7e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Request method failure captured: Sep 03 03:54:17.772589 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: request: GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504 HTTP/1.1 Sep 03 03:54:17.772589 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept: application/json Sep 03 03:54:17.772589 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept-Encoding: identity Sep 03 03:54:17.772589 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Connection: close Sep 03 03:54:17.772589 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Length: 0 Sep 03 03:54:17.772589 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Type: application/json Sep 03 03:54:17.772589 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Host: 10.222.0.25 Sep 03 03:54:17.772589 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Openstack-System-Scope: None Sep 03 03:54:17.772589 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: User-Agent: python-urllib3/1.26.12 Sep 03 03:54:17.772589 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Auth-Token: gAAAAABjEs66Kx8eeteMVyS4cMyfSkiyDGt_1eVtJar0jOqp2U5kldUKx2JCGXQO7DqE-XDheXtg2VZJo07feGC0TW1g6g8FkP9CZLuHpBInyfHfnQ4XyPTBmpEjfujwrAu0nW2aGLx5J777qnmGLgujnVhLN2AJ7Ilf6ZAuow1eLdAaB6k8vVw Sep 03 03:54:17.772589 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Id: None Sep 03 03:54:17.772589 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Name: None Sep 03 03:54:17.772589 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Identity-Status: Confirmed Sep 03 03:54:17.772589 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Is-Admin-Project: True Sep 03 03:54:17.772589 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Id: default Sep 03 03:54:17.772589 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Name: Default Sep 03 03:54:17.772589 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Id: f3077cfc588042e0a1becefe1363385c Sep 03 03:54:17.772589 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1521748712 Sep 03 03:54:17.772589 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Role: member,reader Sep 03 03:54:17.772589 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Roles: member,reader Sep 03 03:54:17.774149 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f3077cfc588042e0a1becefe1363385c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f3077cfc588042e0a1becefe1363385c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f3077cfc588042e0a1becefe1363385c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f3077cfc588042e0a1becefe1363385c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:54:17.774149 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1521748712 Sep 03 03:54:17.774149 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Id: f3077cfc588042e0a1becefe1363385c Sep 03 03:54:17.774149 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1521748712 Sep 03 03:54:17.774149 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User: tempest-ServerRescueNegativeTestJSON-1521748712-project Sep 03 03:54:17.774149 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Id: default Sep 03 03:54:17.774149 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Name: Default Sep 03 03:54:17.774149 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Id: ba00478a6ef74115b83726083026f574 Sep 03 03:54:17.774149 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1521748712-project Sep 03 03:54:17.774149 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: method: > Sep 03 03:54:17.774149 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: exception: Instance f7f92467-64ec-4eba-af52-ad4923543504 could not be found. Sep 03 03:54:17.774149 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: action_args: {'id': 'f7f92467-64ec-4eba-af52-ad4923543504'} Sep 03 03:54:17.775116 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:54:17.775116 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:54:17.775116 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 03:54:17.775116 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 03:54:17.775116 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 03:54:17.775116 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 03:54:17.775116 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 03:54:17.775116 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 03:54:17.775116 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 03:54:17.775116 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 03:54:17.775116 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7f92467-64ec-4eba-af52-ad4923543504 could not be found. Sep 03 03:54:17.775116 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:54:17.775116 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:54:17.775116 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:54:17.775116 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:54:17.775116 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:54:17.775116 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:54:17.775116 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:54:17.775116 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:54:17.775116 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:54:17.776606 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:54:17.776606 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 03:54:17.776606 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 03:54:17.776606 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 03:54:17.776606 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 03:54:17.776606 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 03:54:17.776606 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:54:17.776606 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7f92467-64ec-4eba-af52-ad4923543504 could not be found. Sep 03 03:54:17.776606 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:54:17.776606 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:54:17.776606 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:54:17.776606 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:54:17.776606 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:54:17.776606 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:54:17.776606 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:54:17.776606 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:54:17.776606 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7f92467-64ec-4eba-af52-ad4923543504 could not be found. Sep 03 03:54:17.776606 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:54:17.777988 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-39a57cff-25fa-4bb3-b2a3-fbb5cff1dc7e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] Returning 404 to user: Instance f7f92467-64ec-4eba-af52-ad4923543504 could not be found. {{(pid=132077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:54:17.777988 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-39a57cff-25fa-4bb3-b2a3-fbb5cff1dc7e tempest-ServerRescueNegativeTestJSON-1521748712 tempest-ServerRescueNegativeTestJSON-1521748712-project] 10.222.0.25 "GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504" status: 404 len: 111 microversion: 2.1 time: 0.036415 Sep 03 03:54:17.777988 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 367/737] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:17 2022] GET /compute/v2.1/servers/f7f92467-64ec-4eba-af52-ad4923543504 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 03:54:17.814294 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-775ed2f3-f070-4eda-b6f4-d1535c34f24e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:17.815120 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-775ed2f3-f070-4eda-b6f4-d1535c34f24e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 3d5f7818-14ce-4b6d-b040-6924c777d0d0] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:17.821660 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-775ed2f3-f070-4eda-b6f4-d1535c34f24e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:17.822137 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-775ed2f3-f070-4eda-b6f4-d1535c34f24e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:17.822563 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-775ed2f3-f070-4eda-b6f4-d1535c34f24e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:17.823266 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-775ed2f3-f070-4eda-b6f4-d1535c34f24e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:17.823723 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-775ed2f3-f070-4eda-b6f4-d1535c34f24e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:17.824120 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-775ed2f3-f070-4eda-b6f4-d1535c34f24e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:18.042129 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-775ed2f3-f070-4eda-b6f4-d1535c34f24e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:18.050157 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-775ed2f3-f070-4eda-b6f4-d1535c34f24e tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0" status: 200 len: 1363 microversion: 2.1 time: 0.239987 Sep 03 03:54:18.050719 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 371/738] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:17 2022] GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0 => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:19.073185 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-09fd5744-f1b7-489c-af0d-82b987e0f14b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:19.073821 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-09fd5744-f1b7-489c-af0d-82b987e0f14b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 3d5f7818-14ce-4b6d-b040-6924c777d0d0] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:19.075892 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell0:SELECT=2 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:54:19.076616 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell0:SELECT=6 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:54:19.083252 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-09fd5744-f1b7-489c-af0d-82b987e0f14b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:19.083732 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-09fd5744-f1b7-489c-af0d-82b987e0f14b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:19.084210 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-09fd5744-f1b7-489c-af0d-82b987e0f14b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:19.084859 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-09fd5744-f1b7-489c-af0d-82b987e0f14b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:19.085302 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-09fd5744-f1b7-489c-af0d-82b987e0f14b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:19.085706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-09fd5744-f1b7-489c-af0d-82b987e0f14b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:19.215969 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-09fd5744-f1b7-489c-af0d-82b987e0f14b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:19.224399 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-09fd5744-f1b7-489c-af0d-82b987e0f14b tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0" status: 200 len: 1363 microversion: 2.1 time: 0.156044 Sep 03 03:54:19.224976 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 368/739] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:19 2022] GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:19.310094 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell0:SELECT=6 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:54:19.415146 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-0d6337cd-2be4-4cd6-ac4a-8f2d71df9fcb tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:19.415798 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-0d6337cd-2be4-4cd6-ac4a-8f2d71df9fcb tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 8cbb99ff-b818-4de4-9dde-a3c27164f6af] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:19.421788 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0d6337cd-2be4-4cd6-ac4a-8f2d71df9fcb tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:19.422272 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0d6337cd-2be4-4cd6-ac4a-8f2d71df9fcb tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:19.422696 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0d6337cd-2be4-4cd6-ac4a-8f2d71df9fcb tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:19.423421 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0d6337cd-2be4-4cd6-ac4a-8f2d71df9fcb tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:19.423926 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0d6337cd-2be4-4cd6-ac4a-8f2d71df9fcb tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:19.424306 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0d6337cd-2be4-4cd6-ac4a-8f2d71df9fcb tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:19.452700 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-0d6337cd-2be4-4cd6-ac4a-8f2d71df9fcb tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af/ips" status: 200 len: 148 microversion: 2.1 time: 0.147137 Sep 03 03:54:19.453616 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 372/740] 10.222.0.25 () {58 vars in 1248 bytes} [Sat Sep 3 03:54:19 2022] GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af/ips => generated 148 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:54:20.249619 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-e5448218-781a-4c6b-b997-d66d8872971d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:20.250301 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-e5448218-781a-4c6b-b997-d66d8872971d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 3d5f7818-14ce-4b6d-b040-6924c777d0d0] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:20.257518 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e5448218-781a-4c6b-b997-d66d8872971d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:20.258306 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e5448218-781a-4c6b-b997-d66d8872971d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:20.258400 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e5448218-781a-4c6b-b997-d66d8872971d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:20.259233 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e5448218-781a-4c6b-b997-d66d8872971d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:20.259755 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e5448218-781a-4c6b-b997-d66d8872971d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:20.260176 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e5448218-781a-4c6b-b997-d66d8872971d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:20.399667 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-e5448218-781a-4c6b-b997-d66d8872971d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:20.408040 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-e5448218-781a-4c6b-b997-d66d8872971d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0" status: 200 len: 1363 microversion: 2.1 time: 0.162327 Sep 03 03:54:20.409100 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 369/741] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:20 2022] GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:20.564033 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-c317079e-3b6d-46e9-bba0-faa0fb880f56 req-185099d6-25c9-4d65-b01d-affe16ca3a2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d5f7818-14ce-4b6d-b040-6924c777d0d0", "name": "network-vif-plugged", "status": "completed", "tag": "8bd4fb48-65f5-4f59-8039-923cd37f3c8d"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:54:20.580512 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-c317079e-3b6d-46e9-bba0-faa0fb880f56 req-185099d6-25c9-4d65-b01d-affe16ca3a2a service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:20.581119 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-c317079e-3b6d-46e9-bba0-faa0fb880f56 req-185099d6-25c9-4d65-b01d-affe16ca3a2a service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:20.581542 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-c317079e-3b6d-46e9-bba0-faa0fb880f56 req-185099d6-25c9-4d65-b01d-affe16ca3a2a service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:20.602623 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-c317079e-3b6d-46e9-bba0-faa0fb880f56 req-185099d6-25c9-4d65-b01d-affe16ca3a2a service nova] Creating event network-vif-plugged:8bd4fb48-65f5-4f59-8039-923cd37f3c8d for instance 3d5f7818-14ce-4b6d-b040-6924c777d0d0 on hv-cinder-79966 Sep 03 03:54:20.609727 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-c317079e-3b6d-46e9-bba0-faa0fb880f56 req-185099d6-25c9-4d65-b01d-affe16ca3a2a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049065 Sep 03 03:54:20.611189 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 373/742] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:54:20.820474 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-4b0e6239-8f6e-421c-9367-20681b455f38 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8718acce-3074-4a72-9fbd-abfa65bc4915"}} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:54:20.823078 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-4b0e6239-8f6e-421c-9367-20681b455f38 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 8cbb99ff-b818-4de4-9dde-a3c27164f6af] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:20.829728 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4b0e6239-8f6e-421c-9367-20681b455f38 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:20.830370 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4b0e6239-8f6e-421c-9367-20681b455f38 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:20.830885 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4b0e6239-8f6e-421c-9367-20681b455f38 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:20.831725 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4b0e6239-8f6e-421c-9367-20681b455f38 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:20.832234 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4b0e6239-8f6e-421c-9367-20681b455f38 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:20.832718 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4b0e6239-8f6e-421c-9367-20681b455f38 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:21.328635 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-4b0e6239-8f6e-421c-9367-20681b455f38 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "POST /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.511929 Sep 03 03:54:21.330841 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 370/743] 10.222.0.25 () {60 vars in 1323 bytes} [Sat Sep 3 03:54:20 2022] POST /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af/os-volume_attachments => generated 194 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:54:21.431086 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-1baa1532-c7dc-4ec2-8aa3-863930f1e463 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:21.431810 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-1baa1532-c7dc-4ec2-8aa3-863930f1e463 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 3d5f7818-14ce-4b6d-b040-6924c777d0d0] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:21.446980 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1baa1532-c7dc-4ec2-8aa3-863930f1e463 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:21.447612 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1baa1532-c7dc-4ec2-8aa3-863930f1e463 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:21.448394 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1baa1532-c7dc-4ec2-8aa3-863930f1e463 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:21.449116 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1baa1532-c7dc-4ec2-8aa3-863930f1e463 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:21.449644 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1baa1532-c7dc-4ec2-8aa3-863930f1e463 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:21.450252 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1baa1532-c7dc-4ec2-8aa3-863930f1e463 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:21.602479 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-1baa1532-c7dc-4ec2-8aa3-863930f1e463 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:21.612481 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-1baa1532-c7dc-4ec2-8aa3-863930f1e463 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0" status: 200 len: 1363 microversion: 2.1 time: 0.185577 Sep 03 03:54:21.613293 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 374/744] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:21 2022] GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:22.636933 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-d37b50b6-46dc-4a14-be87-0c466a7f71b3 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:22.637744 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-d37b50b6-46dc-4a14-be87-0c466a7f71b3 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 3d5f7818-14ce-4b6d-b040-6924c777d0d0] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:22.645306 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d37b50b6-46dc-4a14-be87-0c466a7f71b3 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:22.645306 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d37b50b6-46dc-4a14-be87-0c466a7f71b3 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:22.645306 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d37b50b6-46dc-4a14-be87-0c466a7f71b3 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:22.645755 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d37b50b6-46dc-4a14-be87-0c466a7f71b3 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:22.646206 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d37b50b6-46dc-4a14-be87-0c466a7f71b3 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:22.646628 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d37b50b6-46dc-4a14-be87-0c466a7f71b3 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:22.779579 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-d37b50b6-46dc-4a14-be87-0c466a7f71b3 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:22.787695 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-d37b50b6-46dc-4a14-be87-0c466a7f71b3 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0" status: 200 len: 1549 microversion: 2.1 time: 0.155447 Sep 03 03:54:22.788259 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 371/745] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:22 2022] GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0 => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:22.809968 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-2493b45a-cc8d-4888-b810-6d1a85b8a318 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:22.810494 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-2493b45a-cc8d-4888-b810-6d1a85b8a318 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 3d5f7818-14ce-4b6d-b040-6924c777d0d0] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:22.817114 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2493b45a-cc8d-4888-b810-6d1a85b8a318 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:22.817656 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2493b45a-cc8d-4888-b810-6d1a85b8a318 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:22.818085 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2493b45a-cc8d-4888-b810-6d1a85b8a318 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:22.818769 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2493b45a-cc8d-4888-b810-6d1a85b8a318 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:22.819233 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2493b45a-cc8d-4888-b810-6d1a85b8a318 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:22.819649 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2493b45a-cc8d-4888-b810-6d1a85b8a318 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:22.900932 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-2493b45a-cc8d-4888-b810-6d1a85b8a318 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094742 Sep 03 03:54:22.901520 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 375/746] 10.222.0.25 () {58 vars in 1275 bytes} [Sat Sep 3 03:54:22 2022] GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:54:24.079000 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-f81038ee-732a-4532-a070-97e20bc81ff6 req-4a382d2c-d5c0-4a75-af36-1da174ad5f09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d5f7818-14ce-4b6d-b040-6924c777d0d0", "tag": "8bd4fb48-65f5-4f59-8039-923cd37f3c8d"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:54:24.089531 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-f81038ee-732a-4532-a070-97e20bc81ff6 req-4a382d2c-d5c0-4a75-af36-1da174ad5f09 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:24.090002 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-f81038ee-732a-4532-a070-97e20bc81ff6 req-4a382d2c-d5c0-4a75-af36-1da174ad5f09 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:24.090423 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-f81038ee-732a-4532-a070-97e20bc81ff6 req-4a382d2c-d5c0-4a75-af36-1da174ad5f09 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:24.101764 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-f81038ee-732a-4532-a070-97e20bc81ff6 req-4a382d2c-d5c0-4a75-af36-1da174ad5f09 service nova] Creating event network-changed:8bd4fb48-65f5-4f59-8039-923cd37f3c8d for instance 3d5f7818-14ce-4b6d-b040-6924c777d0d0 on hv-cinder-79966 Sep 03 03:54:24.107310 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-f81038ee-732a-4532-a070-97e20bc81ff6 req-4a382d2c-d5c0-4a75-af36-1da174ad5f09 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031569 Sep 03 03:54:24.108104 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 372/747] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:54:28.957840 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-86ee0b2c-9f46-405e-afde-79fcee47a07d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8718acce-3074-4a72-9fbd-abfa65bc4915"}} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:54:28.960223 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-86ee0b2c-9f46-405e-afde-79fcee47a07d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 8cbb99ff-b818-4de4-9dde-a3c27164f6af] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:28.966577 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-86ee0b2c-9f46-405e-afde-79fcee47a07d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:28.967102 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-86ee0b2c-9f46-405e-afde-79fcee47a07d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:28.967533 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-86ee0b2c-9f46-405e-afde-79fcee47a07d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:28.968224 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-86ee0b2c-9f46-405e-afde-79fcee47a07d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:28.968669 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-86ee0b2c-9f46-405e-afde-79fcee47a07d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:28.969092 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-86ee0b2c-9f46-405e-afde-79fcee47a07d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:29.051726 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.wsgi [None req-86ee0b2c-9f46-405e-afde-79fcee47a07d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] HTTP exception thrown: Invalid volume: volume 8718acce-3074-4a72-9fbd-abfa65bc4915 is already attached to instances: 8cbb99ff-b818-4de4-9dde-a3c27164f6af Sep 03 03:54:29.053685 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-86ee0b2c-9f46-405e-afde-79fcee47a07d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Request method failure captured: Sep 03 03:54:29.053685 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: request: POST /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af/os-volume_attachments HTTP/1.1 Sep 03 03:54:29.053685 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept: application/json Sep 03 03:54:29.053685 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept-Encoding: identity Sep 03 03:54:29.053685 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Connection: close Sep 03 03:54:29.053685 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Length: 74 Sep 03 03:54:29.053685 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Type: application/json Sep 03 03:54:29.053685 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Host: 10.222.0.25 Sep 03 03:54:29.053685 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Openstack-System-Scope: None Sep 03 03:54:29.053685 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: User-Agent: python-urllib3/1.26.12 Sep 03 03:54:29.053685 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Auth-Token: gAAAAABjEs650LfhdeTARTcps2T6trtQQt2m5icunzzvIWer-eUYgJYZG5Pjv6m6uWkZdMglMW7-SwnvvwA9dyIFe0GhqjthXj4rFLg5_wGV22DwN7Tu1nE8T--OP86NZDND7AUMPsZwRHed6vQjd_qeShmm1sU59yMmrfP4r0ItLtiNkEQOrd0 Sep 03 03:54:29.053685 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Id: None Sep 03 03:54:29.053685 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Name: None Sep 03 03:54:29.053685 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Identity-Status: Confirmed Sep 03 03:54:29.053685 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Is-Admin-Project: True Sep 03 03:54:29.053685 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Id: default Sep 03 03:54:29.053685 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Name: Default Sep 03 03:54:29.053685 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Id: ac9e77355ba040bda4f2186753df7b24 Sep 03 03:54:29.053685 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Name: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:54:29.053685 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Role: member,reader Sep 03 03:54:29.053685 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Roles: member,reader Sep 03 03:54:29.055090 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:54:29.055090 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:54:29.055090 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Id: ac9e77355ba040bda4f2186753df7b24 Sep 03 03:54:29.055090 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:54:29.055090 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User: tempest-AttachVolumeNegativeTest-1116033749-project Sep 03 03:54:29.055090 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Id: default Sep 03 03:54:29.055090 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Name: Default Sep 03 03:54:29.055090 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Id: 1dde7fad075145c89f726ca85c6c00ba Sep 03 03:54:29.055090 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Name: tempest-AttachVolumeNegativeTest-1116033749-project Sep 03 03:54:29.055090 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Sep 03 03:54:29.055090 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: {"volumeAttachment": {"volumeId": "8718acce-3074-4a72-9fbd-abfa65bc4915"}} Sep 03 03:54:29.055090 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: method: > Sep 03 03:54:29.055941 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: exception: Invalid volume: volume 8718acce-3074-4a72-9fbd-abfa65bc4915 is already attached to instances: 8cbb99ff-b818-4de4-9dde-a3c27164f6af Sep 03 03:54:29.055941 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: action_args: {'server_id': '8cbb99ff-b818-4de4-9dde-a3c27164f6af', 'body': {'volumeAttachment': {'volumeId': '8718acce-3074-4a72-9fbd-abfa65bc4915'}}} Sep 03 03:54:29.055941 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:54:29.055941 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:54:29.055941 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 03 03:54:29.055941 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 03 03:54:29.055941 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 03 03:54:29.055941 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 03 03:54:29.055941 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 03 03:54:29.055941 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 03 03:54:29.055941 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 03 03:54:29.055941 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 03 03:54:29.055941 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 03 03:54:29.055941 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 03 03:54:29.055941 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8718acce-3074-4a72-9fbd-abfa65bc4915 is already attached to instances: 8cbb99ff-b818-4de4-9dde-a3c27164f6af Sep 03 03:54:29.055941 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:54:29.055941 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:54:29.055941 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:54:29.055941 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:54:29.057146 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:54:29.057146 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:54:29.057146 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:54:29.057146 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:54:29.057146 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:54:29.057146 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:54:29.057146 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 03:54:29.057146 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 03:54:29.057146 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 03:54:29.057146 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 03:54:29.057146 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 03:54:29.057146 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 03:54:29.057146 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 03 03:54:29.057146 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 03 03:54:29.057146 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8718acce-3074-4a72-9fbd-abfa65bc4915 is already attached to instances: 8cbb99ff-b818-4de4-9dde-a3c27164f6af Sep 03 03:54:29.057146 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:54:29.057146 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:54:29.057146 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:54:29.057146 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:54:29.057146 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:54:29.058471 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:54:29.058471 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:54:29.058471 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:54:29.058471 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8718acce-3074-4a72-9fbd-abfa65bc4915 is already attached to instances: 8cbb99ff-b818-4de4-9dde-a3c27164f6af Sep 03 03:54:29.058471 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:54:29.058471 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-86ee0b2c-9f46-405e-afde-79fcee47a07d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Returning 400 to user: Invalid volume: volume 8718acce-3074-4a72-9fbd-abfa65bc4915 is already attached to instances: 8cbb99ff-b818-4de4-9dde-a3c27164f6af {{(pid=132076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:54:29.058471 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-86ee0b2c-9f46-405e-afde-79fcee47a07d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "POST /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101980 Sep 03 03:54:29.058471 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 376/748] 10.222.0.25 () {60 vars in 1323 bytes} [Sat Sep 3 03:54:28 2022] POST /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 03:54:29.123640 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-b477d43c-354c-47d7-a209-c1f9f927db20 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:29.124169 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-b477d43c-354c-47d7-a209-c1f9f927db20 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 8cbb99ff-b818-4de4-9dde-a3c27164f6af] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:29.126132 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:54:29.131877 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b477d43c-354c-47d7-a209-c1f9f927db20 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:29.132349 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b477d43c-354c-47d7-a209-c1f9f927db20 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:29.132775 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b477d43c-354c-47d7-a209-c1f9f927db20 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:29.133461 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b477d43c-354c-47d7-a209-c1f9f927db20 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:29.133906 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b477d43c-354c-47d7-a209-c1f9f927db20 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:29.134317 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b477d43c-354c-47d7-a209-c1f9f927db20 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:29.217406 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.objects.instance [None req-b477d43c-354c-47d7-a209-c1f9f927db20 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lazy-loading 'services' on Instance uuid 8cbb99ff-b818-4de4-9dde-a3c27164f6af {{(pid=132077) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 03:54:29.293967 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-b477d43c-354c-47d7-a209-c1f9f927db20 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af/os-volume_attachments/8718acce-3074-4a72-9fbd-abfa65bc4915" status: 202 len: 0 microversion: 2.1 time: 0.175160 Sep 03 03:54:29.294541 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 373/749] 10.222.0.25 () {58 vars in 1416 bytes} [Sat Sep 3 03:54:29 2022] DELETE /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af/os-volume_attachments/8718acce-3074-4a72-9fbd-abfa65bc4915 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 03:54:29.303389 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-f70d9a5e-fa30-4c7f-a648-91ee59ef7a63 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:29.305520 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-f70d9a5e-fa30-4c7f-a648-91ee59ef7a63 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 8cbb99ff-b818-4de4-9dde-a3c27164f6af] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:29.312648 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f70d9a5e-fa30-4c7f-a648-91ee59ef7a63 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:29.313148 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f70d9a5e-fa30-4c7f-a648-91ee59ef7a63 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:29.313650 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f70d9a5e-fa30-4c7f-a648-91ee59ef7a63 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:29.314445 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f70d9a5e-fa30-4c7f-a648-91ee59ef7a63 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:29.314922 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f70d9a5e-fa30-4c7f-a648-91ee59ef7a63 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:29.315372 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f70d9a5e-fa30-4c7f-a648-91ee59ef7a63 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:29.345013 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-f70d9a5e-fa30-4c7f-a648-91ee59ef7a63 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045749 Sep 03 03:54:29.345573 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 377/750] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Sep 3 03:54:29 2022] GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:54:30.241421 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-ca326ba3-0728-4908-8dc8-bbb067b3f372 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:30.242665 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-ca326ba3-0728-4908-8dc8-bbb067b3f372 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:30.249416 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ca326ba3-0728-4908-8dc8-bbb067b3f372 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:30.249966 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ca326ba3-0728-4908-8dc8-bbb067b3f372 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:30.250485 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ca326ba3-0728-4908-8dc8-bbb067b3f372 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:30.251300 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ca326ba3-0728-4908-8dc8-bbb067b3f372 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:30.251950 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ca326ba3-0728-4908-8dc8-bbb067b3f372 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:30.252562 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ca326ba3-0728-4908-8dc8-bbb067b3f372 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:30.278954 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-ca326ba3-0728-4908-8dc8-bbb067b3f372 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43/ips" status: 200 len: 152 microversion: 2.20 time: 0.226977 Sep 03 03:54:30.279535 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 374/751] 10.222.0.25 () {60 vars in 1289 bytes} [Sat Sep 3 03:54:30 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43/ips => generated 152 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 03:54:30.360323 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-233bf19a-fccb-4693-bf12-46f96e42a98e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:30.362862 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-233bf19a-fccb-4693-bf12-46f96e42a98e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 8cbb99ff-b818-4de4-9dde-a3c27164f6af] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:30.369788 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-233bf19a-fccb-4693-bf12-46f96e42a98e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:30.370551 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-233bf19a-fccb-4693-bf12-46f96e42a98e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:30.371066 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-233bf19a-fccb-4693-bf12-46f96e42a98e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:30.371839 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-233bf19a-fccb-4693-bf12-46f96e42a98e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:30.372540 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-233bf19a-fccb-4693-bf12-46f96e42a98e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:30.372897 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-233bf19a-fccb-4693-bf12-46f96e42a98e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:30.403561 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-233bf19a-fccb-4693-bf12-46f96e42a98e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048018 Sep 03 03:54:30.404293 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 378/752] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Sep 3 03:54:30 2022] GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 03:54:30.477346 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-63c91e57-e95d-4f72-b458-fd1a7cce78c5 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:30.478041 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-63c91e57-e95d-4f72-b458-fd1a7cce78c5 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 8cbb99ff-b818-4de4-9dde-a3c27164f6af] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:30.485349 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-63c91e57-e95d-4f72-b458-fd1a7cce78c5 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:30.485976 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-63c91e57-e95d-4f72-b458-fd1a7cce78c5 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:30.486406 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-63c91e57-e95d-4f72-b458-fd1a7cce78c5 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:30.487164 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-63c91e57-e95d-4f72-b458-fd1a7cce78c5 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:30.487626 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-63c91e57-e95d-4f72-b458-fd1a7cce78c5 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:30.488032 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-63c91e57-e95d-4f72-b458-fd1a7cce78c5 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:30.517631 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-63c91e57-e95d-4f72-b458-fd1a7cce78c5 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 8cbb99ff-b818-4de4-9dde-a3c27164f6af] Going to try to terminate instance {{(pid=132077) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 03:54:30.555698 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:54:30.603112 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-63c91e57-e95d-4f72-b458-fd1a7cce78c5 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af" status: 204 len: 0 microversion: 2.1 time: 0.130170 Sep 03 03:54:30.603663 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 375/753] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Sep 3 03:54:30 2022] DELETE /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 03:54:30.613450 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-5264a4a4-5e2a-4c71-9019-3e2f76ba3a41 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:30.614055 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-5264a4a4-5e2a-4c71-9019-3e2f76ba3a41 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 8cbb99ff-b818-4de4-9dde-a3c27164f6af] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:30.621670 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5264a4a4-5e2a-4c71-9019-3e2f76ba3a41 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:30.622169 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5264a4a4-5e2a-4c71-9019-3e2f76ba3a41 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:30.622853 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5264a4a4-5e2a-4c71-9019-3e2f76ba3a41 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:30.623737 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5264a4a4-5e2a-4c71-9019-3e2f76ba3a41 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:30.624181 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5264a4a4-5e2a-4c71-9019-3e2f76ba3a41 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:30.624591 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5264a4a4-5e2a-4c71-9019-3e2f76ba3a41 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:30.768036 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-5264a4a4-5e2a-4c71-9019-3e2f76ba3a41 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:30.770382 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell1:SELECT=100 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:54:30.777560 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-5264a4a4-5e2a-4c71-9019-3e2f76ba3a41 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af" status: 200 len: 1681 microversion: 2.1 time: 0.168488 Sep 03 03:54:30.778122 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 379/754] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:30 2022] GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:31.801584 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-b6dfee28-d6c2-4662-9877-843ddbce9a7f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:31.802283 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-b6dfee28-d6c2-4662-9877-843ddbce9a7f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 8cbb99ff-b818-4de4-9dde-a3c27164f6af] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:31.809040 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b6dfee28-d6c2-4662-9877-843ddbce9a7f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:31.809521 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b6dfee28-d6c2-4662-9877-843ddbce9a7f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:31.809952 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b6dfee28-d6c2-4662-9877-843ddbce9a7f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:31.810659 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b6dfee28-d6c2-4662-9877-843ddbce9a7f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:31.811119 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b6dfee28-d6c2-4662-9877-843ddbce9a7f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:31.811569 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b6dfee28-d6c2-4662-9877-843ddbce9a7f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:31.960167 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-b6dfee28-d6c2-4662-9877-843ddbce9a7f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:31.971802 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-b6dfee28-d6c2-4662-9877-843ddbce9a7f tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af" status: 200 len: 1681 microversion: 2.1 time: 0.174212 Sep 03 03:54:31.972346 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 376/755] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:31 2022] GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:32.150270 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-345f5984-634d-48ca-9edc-75daed68951b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:54:32.150945 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-345f5984-634d-48ca-9edc-75daed68951b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:32.157695 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-345f5984-634d-48ca-9edc-75daed68951b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:32.158133 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-345f5984-634d-48ca-9edc-75daed68951b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:32.158556 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-345f5984-634d-48ca-9edc-75daed68951b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:32.159275 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-345f5984-634d-48ca-9edc-75daed68951b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:32.159719 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-345f5984-634d-48ca-9edc-75daed68951b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:32.160135 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-345f5984-634d-48ca-9edc-75daed68951b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:32.183073 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.objects.instance [None req-345f5984-634d-48ca-9edc-75daed68951b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lazy-loading 'flavor' on Instance uuid cc53cf40-e9bf-4403-92b0-7bae49adae43 {{(pid=132076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 03:54:32.379819 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-345f5984-634d-48ca-9edc-75daed68951b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "POST /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43/action" status: 202 len: 0 microversion: 2.20 time: 0.233319 Sep 03 03:54:32.380574 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 380/756] 10.222.0.25 () {62 vars in 1319 bytes} [Sat Sep 3 03:54:32 2022] POST /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 03 03:54:32.392504 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-c66b1348-903a-4f9c-b300-16a2ce74aa0c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:32.393393 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-c66b1348-903a-4f9c-b300-16a2ce74aa0c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:32.400651 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c66b1348-903a-4f9c-b300-16a2ce74aa0c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:32.401138 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c66b1348-903a-4f9c-b300-16a2ce74aa0c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:32.401761 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c66b1348-903a-4f9c-b300-16a2ce74aa0c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:32.402509 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c66b1348-903a-4f9c-b300-16a2ce74aa0c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:32.402992 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c66b1348-903a-4f9c-b300-16a2ce74aa0c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:32.403415 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c66b1348-903a-4f9c-b300-16a2ce74aa0c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:32.540060 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-c66b1348-903a-4f9c-b300-16a2ce74aa0c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:32.548706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-c66b1348-903a-4f9c-b300-16a2ce74aa0c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:32.550215 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-c66b1348-903a-4f9c-b300-16a2ce74aa0c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:32.551502 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-c66b1348-903a-4f9c-b300-16a2ce74aa0c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1723 microversion: 2.20 time: 0.165040 Sep 03 03:54:32.552130 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 377/757] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:54:32 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:54:33.007660 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-f15f4ba0-ea79-46d3-9bba-e88cec337042 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:33.008361 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-f15f4ba0-ea79-46d3-9bba-e88cec337042 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 8cbb99ff-b818-4de4-9dde-a3c27164f6af] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:33.023921 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f15f4ba0-ea79-46d3-9bba-e88cec337042 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:33.024911 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f15f4ba0-ea79-46d3-9bba-e88cec337042 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:33.025554 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f15f4ba0-ea79-46d3-9bba-e88cec337042 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:33.026486 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f15f4ba0-ea79-46d3-9bba-e88cec337042 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:33.027176 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f15f4ba0-ea79-46d3-9bba-e88cec337042 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:33.027603 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f15f4ba0-ea79-46d3-9bba-e88cec337042 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:33.082274 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-d6b4f58f-edbf-4f54-975e-30e08b448aaa req-b5c000f6-4429-4e93-b4e9-47a2b6501fec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cbb99ff-b818-4de4-9dde-a3c27164f6af", "name": "network-vif-deleted", "tag": "d1286d66-938e-4851-b4f8-27c123ccbf56"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:54:33.104068 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-d6b4f58f-edbf-4f54-975e-30e08b448aaa req-b5c000f6-4429-4e93-b4e9-47a2b6501fec service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:33.111390 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-d6b4f58f-edbf-4f54-975e-30e08b448aaa req-b5c000f6-4429-4e93-b4e9-47a2b6501fec service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:33.112060 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-d6b4f58f-edbf-4f54-975e-30e08b448aaa req-b5c000f6-4429-4e93-b4e9-47a2b6501fec service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:33.125478 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-f15f4ba0-ea79-46d3-9bba-e88cec337042 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:33.135560 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-d6b4f58f-edbf-4f54-975e-30e08b448aaa req-b5c000f6-4429-4e93-b4e9-47a2b6501fec service nova] Creating event network-vif-deleted:d1286d66-938e-4851-b4f8-27c123ccbf56 for instance 8cbb99ff-b818-4de4-9dde-a3c27164f6af on hv-cinder-79966 Sep 03 03:54:33.140617 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-d6b4f58f-edbf-4f54-975e-30e08b448aaa req-b5c000f6-4429-4e93-b4e9-47a2b6501fec service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061663 Sep 03 03:54:33.141226 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-f15f4ba0-ea79-46d3-9bba-e88cec337042 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af" status: 200 len: 1613 microversion: 2.1 time: 0.146237 Sep 03 03:54:33.141702 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 378/758] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:54:33.142243 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 381/759] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:32 2022] GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af => generated 1613 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:33.577501 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-dc2cc417-feee-4be1-9dc8-af972a37821c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:33.578637 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-dc2cc417-feee-4be1-9dc8-af972a37821c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:33.585360 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-dc2cc417-feee-4be1-9dc8-af972a37821c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:33.585838 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-dc2cc417-feee-4be1-9dc8-af972a37821c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:33.586263 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-dc2cc417-feee-4be1-9dc8-af972a37821c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:33.586996 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-dc2cc417-feee-4be1-9dc8-af972a37821c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:33.587432 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-dc2cc417-feee-4be1-9dc8-af972a37821c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:33.587844 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-dc2cc417-feee-4be1-9dc8-af972a37821c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:33.724891 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-dc2cc417-feee-4be1-9dc8-af972a37821c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:33.735148 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-dc2cc417-feee-4be1-9dc8-af972a37821c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:33.736575 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-dc2cc417-feee-4be1-9dc8-af972a37821c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:33.737737 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-dc2cc417-feee-4be1-9dc8-af972a37821c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1723 microversion: 2.20 time: 0.164906 Sep 03 03:54:33.738284 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 379/760] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:54:33 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:54:34.166172 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-7afe01ed-37f3-4a26-a4a9-fcfb720235f4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:34.166779 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-7afe01ed-37f3-4a26-a4a9-fcfb720235f4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 8cbb99ff-b818-4de4-9dde-a3c27164f6af] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:34.169237 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:54:34.174871 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7afe01ed-37f3-4a26-a4a9-fcfb720235f4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:34.175379 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7afe01ed-37f3-4a26-a4a9-fcfb720235f4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:34.175814 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7afe01ed-37f3-4a26-a4a9-fcfb720235f4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:34.176508 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7afe01ed-37f3-4a26-a4a9-fcfb720235f4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:34.176954 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7afe01ed-37f3-4a26-a4a9-fcfb720235f4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:34.177379 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7afe01ed-37f3-4a26-a4a9-fcfb720235f4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:34.191956 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.wsgi [None req-7afe01ed-37f3-4a26-a4a9-fcfb720235f4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] HTTP exception thrown: Instance 8cbb99ff-b818-4de4-9dde-a3c27164f6af could not be found. Sep 03 03:54:34.193670 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-7afe01ed-37f3-4a26-a4a9-fcfb720235f4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Request method failure captured: Sep 03 03:54:34.193670 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: request: GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af HTTP/1.1 Sep 03 03:54:34.193670 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept: application/json Sep 03 03:54:34.193670 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept-Encoding: identity Sep 03 03:54:34.193670 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Connection: close Sep 03 03:54:34.193670 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Length: 0 Sep 03 03:54:34.193670 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Type: application/json Sep 03 03:54:34.193670 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Host: 10.222.0.25 Sep 03 03:54:34.193670 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Openstack-System-Scope: None Sep 03 03:54:34.193670 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: User-Agent: python-urllib3/1.26.12 Sep 03 03:54:34.193670 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Auth-Token: gAAAAABjEs650LfhdeTARTcps2T6trtQQt2m5icunzzvIWer-eUYgJYZG5Pjv6m6uWkZdMglMW7-SwnvvwA9dyIFe0GhqjthXj4rFLg5_wGV22DwN7Tu1nE8T--OP86NZDND7AUMPsZwRHed6vQjd_qeShmm1sU59yMmrfP4r0ItLtiNkEQOrd0 Sep 03 03:54:34.193670 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Id: None Sep 03 03:54:34.193670 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Name: None Sep 03 03:54:34.193670 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Identity-Status: Confirmed Sep 03 03:54:34.193670 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Is-Admin-Project: True Sep 03 03:54:34.193670 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Id: default Sep 03 03:54:34.193670 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Name: Default Sep 03 03:54:34.193670 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Id: ac9e77355ba040bda4f2186753df7b24 Sep 03 03:54:34.193670 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Name: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:54:34.193670 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Role: member,reader Sep 03 03:54:34.193670 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Roles: member,reader Sep 03 03:54:34.195081 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:54:34.195081 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:54:34.195081 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Id: ac9e77355ba040bda4f2186753df7b24 Sep 03 03:54:34.195081 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:54:34.195081 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User: tempest-AttachVolumeNegativeTest-1116033749-project Sep 03 03:54:34.195081 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Id: default Sep 03 03:54:34.195081 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Name: Default Sep 03 03:54:34.195081 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Id: 1dde7fad075145c89f726ca85c6c00ba Sep 03 03:54:34.195081 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Name: tempest-AttachVolumeNegativeTest-1116033749-project Sep 03 03:54:34.195081 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: method: > Sep 03 03:54:34.195081 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: exception: Instance 8cbb99ff-b818-4de4-9dde-a3c27164f6af could not be found. Sep 03 03:54:34.195081 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: action_args: {'id': '8cbb99ff-b818-4de4-9dde-a3c27164f6af'} Sep 03 03:54:34.195843 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:54:34.195843 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:54:34.195843 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 03:54:34.195843 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 03:54:34.195843 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 03:54:34.195843 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 03:54:34.195843 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 03:54:34.195843 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 03:54:34.195843 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 03:54:34.195843 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 03:54:34.195843 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cbb99ff-b818-4de4-9dde-a3c27164f6af could not be found. Sep 03 03:54:34.195843 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:54:34.195843 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:54:34.195843 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:54:34.195843 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:54:34.195843 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:54:34.195843 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:54:34.195843 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:54:34.195843 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:54:34.195843 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:54:34.197479 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:54:34.197479 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 03:54:34.197479 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 03:54:34.197479 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 03:54:34.197479 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 03:54:34.197479 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 03:54:34.197479 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:54:34.197479 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cbb99ff-b818-4de4-9dde-a3c27164f6af could not be found. Sep 03 03:54:34.197479 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:54:34.197479 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:54:34.197479 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:54:34.197479 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:54:34.197479 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:54:34.197479 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:54:34.197479 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:54:34.197479 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:54:34.197479 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cbb99ff-b818-4de4-9dde-a3c27164f6af could not be found. Sep 03 03:54:34.197479 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:54:34.198978 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-7afe01ed-37f3-4a26-a4a9-fcfb720235f4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Returning 404 to user: Instance 8cbb99ff-b818-4de4-9dde-a3c27164f6af could not be found. {{(pid=132076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:54:34.198978 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-7afe01ed-37f3-4a26-a4a9-fcfb720235f4 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af" status: 404 len: 111 microversion: 2.1 time: 0.033250 Sep 03 03:54:34.198978 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 382/761] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:34 2022] GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 03:54:34.204408 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-49af22a4-87c3-4dc5-ac4c-7f51be0b777b tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '.version_select at 0x7f45fc5a4af0>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:34.224186 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-49af22a4-87c3-4dc5-ac4c-7f51be0b777b tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1889348533" status: 202 len: 0 microversion: 2.1 time: 0.023613 Sep 03 03:54:34.224791 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 380/762] 10.222.0.25 () {58 vars in 1221 bytes} [Sat Sep 3 03:54:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1889348533 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 03:54:34.762409 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-cd4159d3-ada4-4aea-a59e-dbfcb98e18da tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:34.763008 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-cd4159d3-ada4-4aea-a59e-dbfcb98e18da tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:34.768996 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cd4159d3-ada4-4aea-a59e-dbfcb98e18da tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:34.769472 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cd4159d3-ada4-4aea-a59e-dbfcb98e18da tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:34.769896 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cd4159d3-ada4-4aea-a59e-dbfcb98e18da tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:34.770570 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cd4159d3-ada4-4aea-a59e-dbfcb98e18da tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:34.771033 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cd4159d3-ada4-4aea-a59e-dbfcb98e18da tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:34.771487 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cd4159d3-ada4-4aea-a59e-dbfcb98e18da tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:34.908022 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-7830de15-a2e1-48b5-9fca-48f3d23a63cd tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Action: 'create', calling method: .version_select at 0x7f45fc586430>, body: {"keypair": {"name": "tempest-keypair-777163056", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5h8DTTboqnOqcqCEnBnkTKE2Mm2KXjB30Bhs5Dip/7N552W8Gc2o00LAZGl1/ThRp4YB/5547f47b01zd15AWFD4qsWsjk/HmNExHHL0JqMW+bKwAhFirnZxfo8bLJZA=="}} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:54:34.924864 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.quota [None req-7830de15-a2e1-48b5-9fca-48f3d23a63cd tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Getting quotas for project ac9e77355ba040bda4f2186753df7b24. Resources: {'key_pairs'} {{(pid=132077) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 03:54:34.928861 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.quota [None req-7830de15-a2e1-48b5-9fca-48f3d23a63cd tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Getting quotas for user 1dde7fad075145c89f726ca85c6c00ba and project ac9e77355ba040bda4f2186753df7b24. Resources: {'key_pairs'} {{(pid=132077) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 03:54:34.936527 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-cd4159d3-ada4-4aea-a59e-dbfcb98e18da tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:34.944781 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-cd4159d3-ada4-4aea-a59e-dbfcb98e18da tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:34.946301 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-cd4159d3-ada4-4aea-a59e-dbfcb98e18da tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:34.947657 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-cd4159d3-ada4-4aea-a59e-dbfcb98e18da tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1723 microversion: 2.20 time: 0.188967 Sep 03 03:54:34.948188 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 383/763] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:54:34 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:54:34.952062 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-7830de15-a2e1-48b5-9fca-48f3d23a63cd tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047934 Sep 03 03:54:34.954885 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 381/764] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Sep 3 03:54:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 03:54:35.974063 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-b7574e1d-54fb-4991-a9b6-5b7ce9a39795 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:35.974708 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-b7574e1d-54fb-4991-a9b6-5b7ce9a39795 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:35.981566 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b7574e1d-54fb-4991-a9b6-5b7ce9a39795 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:35.982055 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b7574e1d-54fb-4991-a9b6-5b7ce9a39795 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:35.982493 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b7574e1d-54fb-4991-a9b6-5b7ce9a39795 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:35.983208 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b7574e1d-54fb-4991-a9b6-5b7ce9a39795 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:35.983656 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b7574e1d-54fb-4991-a9b6-5b7ce9a39795 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:35.984075 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b7574e1d-54fb-4991-a9b6-5b7ce9a39795 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:36.118484 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-b7574e1d-54fb-4991-a9b6-5b7ce9a39795 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:36.127686 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-b7574e1d-54fb-4991-a9b6-5b7ce9a39795 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:36.129129 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-b7574e1d-54fb-4991-a9b6-5b7ce9a39795 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:36.130332 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-b7574e1d-54fb-4991-a9b6-5b7ce9a39795 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1723 microversion: 2.20 time: 0.161023 Sep 03 03:54:36.130879 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 384/765] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:54:35 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:54:36.270707 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-800688ec-3ae4-4dda-86b8-ae02b5295185 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-199246270", "imageRef": "0af209bb-870a-4343-a9f9-de05883bb8dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3310a324-39c6-4074-b839-e8b47e45dc07"}], "security_groups": [{"name": "tempest-securitygroup--310607738"}], "key_name": "tempest-keypair-777163056", "user_data": "}} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:54:36.375579 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.network.neutron [None req-800688ec-3ae4-4dda-86b8-ae02b5295185 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] validate_networks() for [('3310a324-39c6-4074-b839-e8b47e45dc07', None, None, None, None, None)] {{(pid=132077) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 03:54:36.861588 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-800688ec-3ae4-4dda-86b8-ae02b5295185 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Flavor limits 0:0:0 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 03:54:36.862008 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-800688ec-3ae4-4dda-86b8-ae02b5295185 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Image limits 0:0:0 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 03:54:36.862470 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-800688ec-3ae4-4dda-86b8-ae02b5295185 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Flavor pref 0:0:0 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 03:54:36.862860 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-800688ec-3ae4-4dda-86b8-ae02b5295185 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Image pref 0:0:0 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 03:54:36.863292 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-800688ec-3ae4-4dda-86b8-ae02b5295185 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 03:54:36.872248 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-800688ec-3ae4-4dda-86b8-ae02b5295185 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:36.872935 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-800688ec-3ae4-4dda-86b8-ae02b5295185 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:36.873348 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-800688ec-3ae4-4dda-86b8-ae02b5295185 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:36.874064 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-800688ec-3ae4-4dda-86b8-ae02b5295185 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:36.874509 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-800688ec-3ae4-4dda-86b8-ae02b5295185 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:36.874955 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-800688ec-3ae4-4dda-86b8-ae02b5295185 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:36.891410 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.quota [None req-800688ec-3ae4-4dda-86b8-ae02b5295185 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Getting quotas for project ac9e77355ba040bda4f2186753df7b24. Resources: {'ram', 'instances', 'cores'} {{(pid=132077) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 03:54:36.895459 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.quota [None req-800688ec-3ae4-4dda-86b8-ae02b5295185 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Getting quotas for user 1dde7fad075145c89f726ca85c6c00ba and project ac9e77355ba040bda4f2186753df7b24. Resources: {'ram', 'instances', 'cores'} {{(pid=132077) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 03:54:36.906928 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-800688ec-3ae4-4dda-86b8-ae02b5295185 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Going to run 1 instances... {{(pid=132077) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 03:54:36.909228 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-800688ec-3ae4-4dda-86b8-ae02b5295185 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: d1d08b5f-9032-4848-ba25-122cd62f1432] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0af209bb-870a-4343-a9f9-de05883bb8dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132077) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 03:54:36.955584 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-800688ec-3ae4-4dda-86b8-ae02b5295185 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.689656 Sep 03 03:54:36.956348 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 382/766] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Sep 3 03:54:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 03:54:36.967897 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-57ebc884-8599-4a97-9606-18f29675323d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:36.968648 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-57ebc884-8599-4a97-9606-18f29675323d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: d1d08b5f-9032-4848-ba25-122cd62f1432] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:37.028527 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-57ebc884-8599-4a97-9606-18f29675323d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:37.035965 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-57ebc884-8599-4a97-9606-18f29675323d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432" status: 200 len: 1240 microversion: 2.1 time: 0.071993 Sep 03 03:54:37.036537 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 385/767] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:36 2022] GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432 => generated 1240 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:37.156297 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-2c218ad2-89a7-4e0d-a48e-4fa270a59182 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:37.157089 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-2c218ad2-89a7-4e0d-a48e-4fa270a59182 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:37.163903 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2c218ad2-89a7-4e0d-a48e-4fa270a59182 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:37.164400 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2c218ad2-89a7-4e0d-a48e-4fa270a59182 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:37.164829 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2c218ad2-89a7-4e0d-a48e-4fa270a59182 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:37.165540 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2c218ad2-89a7-4e0d-a48e-4fa270a59182 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:37.165973 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2c218ad2-89a7-4e0d-a48e-4fa270a59182 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:37.166406 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2c218ad2-89a7-4e0d-a48e-4fa270a59182 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:37.316179 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-2c218ad2-89a7-4e0d-a48e-4fa270a59182 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:37.325166 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-2c218ad2-89a7-4e0d-a48e-4fa270a59182 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:37.327138 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-2c218ad2-89a7-4e0d-a48e-4fa270a59182 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:37.328447 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-2c218ad2-89a7-4e0d-a48e-4fa270a59182 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1723 microversion: 2.20 time: 0.176085 Sep 03 03:54:37.329401 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 383/768] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:54:37 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:54:38.073389 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-7c1bf8d6-18dd-489c-bbf1-e7987a70eb14 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:38.073984 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-7c1bf8d6-18dd-489c-bbf1-e7987a70eb14 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: d1d08b5f-9032-4848-ba25-122cd62f1432] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:38.083522 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7c1bf8d6-18dd-489c-bbf1-e7987a70eb14 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:38.084187 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7c1bf8d6-18dd-489c-bbf1-e7987a70eb14 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:38.084834 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7c1bf8d6-18dd-489c-bbf1-e7987a70eb14 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:38.085725 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7c1bf8d6-18dd-489c-bbf1-e7987a70eb14 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:38.086431 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7c1bf8d6-18dd-489c-bbf1-e7987a70eb14 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:38.087123 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7c1bf8d6-18dd-489c-bbf1-e7987a70eb14 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:38.153970 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-7c1bf8d6-18dd-489c-bbf1-e7987a70eb14 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:38.162158 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-7c1bf8d6-18dd-489c-bbf1-e7987a70eb14 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432" status: 200 len: 1292 microversion: 2.1 time: 0.095779 Sep 03 03:54:38.162880 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 386/769] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:38 2022] GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432 => generated 1292 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:38.355122 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-a936ed25-31a2-4fe6-9fb8-c8b9603fa808 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:38.355884 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-a936ed25-31a2-4fe6-9fb8-c8b9603fa808 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:38.363289 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a936ed25-31a2-4fe6-9fb8-c8b9603fa808 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:38.363787 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a936ed25-31a2-4fe6-9fb8-c8b9603fa808 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:38.364225 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a936ed25-31a2-4fe6-9fb8-c8b9603fa808 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:38.364928 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a936ed25-31a2-4fe6-9fb8-c8b9603fa808 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:38.365382 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a936ed25-31a2-4fe6-9fb8-c8b9603fa808 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:38.365917 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a936ed25-31a2-4fe6-9fb8-c8b9603fa808 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:38.501935 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a936ed25-31a2-4fe6-9fb8-c8b9603fa808 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:38.510102 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a936ed25-31a2-4fe6-9fb8-c8b9603fa808 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:38.511650 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a936ed25-31a2-4fe6-9fb8-c8b9603fa808 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:38.513103 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-a936ed25-31a2-4fe6-9fb8-c8b9603fa808 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1723 microversion: 2.20 time: 0.162125 Sep 03 03:54:38.513833 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 384/770] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:54:38 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:54:39.189096 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-973d2025-3b68-4159-9c78-a3d037858a1d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:39.195589 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-973d2025-3b68-4159-9c78-a3d037858a1d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: d1d08b5f-9032-4848-ba25-122cd62f1432] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:39.208360 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-973d2025-3b68-4159-9c78-a3d037858a1d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:39.209495 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-973d2025-3b68-4159-9c78-a3d037858a1d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:39.210216 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-973d2025-3b68-4159-9c78-a3d037858a1d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:39.211584 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-973d2025-3b68-4159-9c78-a3d037858a1d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:39.212315 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-973d2025-3b68-4159-9c78-a3d037858a1d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:39.212962 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-973d2025-3b68-4159-9c78-a3d037858a1d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:39.497228 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-973d2025-3b68-4159-9c78-a3d037858a1d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:39.519972 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-973d2025-3b68-4159-9c78-a3d037858a1d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432" status: 200 len: 1365 microversion: 2.1 time: 0.337405 Sep 03 03:54:39.532213 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 387/771] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:39 2022] GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432 => generated 1365 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:39.543144 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-6fbe3417-3b8f-4a00-ad40-d54baf3b8d15 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:39.544516 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-6fbe3417-3b8f-4a00-ad40-d54baf3b8d15 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:39.552474 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6fbe3417-3b8f-4a00-ad40-d54baf3b8d15 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:39.553387 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6fbe3417-3b8f-4a00-ad40-d54baf3b8d15 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:39.553971 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6fbe3417-3b8f-4a00-ad40-d54baf3b8d15 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:39.554714 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6fbe3417-3b8f-4a00-ad40-d54baf3b8d15 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:39.555224 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6fbe3417-3b8f-4a00-ad40-d54baf3b8d15 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:39.555817 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6fbe3417-3b8f-4a00-ad40-d54baf3b8d15 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:39.705700 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-6fbe3417-3b8f-4a00-ad40-d54baf3b8d15 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:39.714652 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-6fbe3417-3b8f-4a00-ad40-d54baf3b8d15 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:39.716118 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-6fbe3417-3b8f-4a00-ad40-d54baf3b8d15 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:39.717287 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-6fbe3417-3b8f-4a00-ad40-d54baf3b8d15 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1723 microversion: 2.20 time: 0.178355 Sep 03 03:54:39.717841 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 385/772] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:54:39 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:54:40.032181 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-d21de1ed-d0f2-40d2-82c2-31ae02e7ba09 req-185922f0-9b94-4d3a-8add-a2cc350d581a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1d08b5f-9032-4848-ba25-122cd62f1432", "tag": "4369d0d8-6566-4456-8e12-b1fef3c45df0"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:54:40.060362 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-d21de1ed-d0f2-40d2-82c2-31ae02e7ba09 req-185922f0-9b94-4d3a-8add-a2cc350d581a service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:40.061231 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-d21de1ed-d0f2-40d2-82c2-31ae02e7ba09 req-185922f0-9b94-4d3a-8add-a2cc350d581a service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:40.062295 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-d21de1ed-d0f2-40d2-82c2-31ae02e7ba09 req-185922f0-9b94-4d3a-8add-a2cc350d581a service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:40.078334 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-d21de1ed-d0f2-40d2-82c2-31ae02e7ba09 req-185922f0-9b94-4d3a-8add-a2cc350d581a service nova] Creating event network-changed:4369d0d8-6566-4456-8e12-b1fef3c45df0 for instance d1d08b5f-9032-4848-ba25-122cd62f1432 on hv-cinder-79966 Sep 03 03:54:40.084757 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-d21de1ed-d0f2-40d2-82c2-31ae02e7ba09 req-185922f0-9b94-4d3a-8add-a2cc350d581a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065975 Sep 03 03:54:40.085547 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 388/773] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:54:40.544124 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-2317f8f3-2935-4296-ba13-286cfce3ce8e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:40.544726 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-2317f8f3-2935-4296-ba13-286cfce3ce8e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: d1d08b5f-9032-4848-ba25-122cd62f1432] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:40.550651 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2317f8f3-2935-4296-ba13-286cfce3ce8e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:40.551152 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2317f8f3-2935-4296-ba13-286cfce3ce8e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:40.551574 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2317f8f3-2935-4296-ba13-286cfce3ce8e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:40.552259 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2317f8f3-2935-4296-ba13-286cfce3ce8e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:40.552703 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2317f8f3-2935-4296-ba13-286cfce3ce8e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:40.553117 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2317f8f3-2935-4296-ba13-286cfce3ce8e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:40.686834 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-2317f8f3-2935-4296-ba13-286cfce3ce8e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:40.694612 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-2317f8f3-2935-4296-ba13-286cfce3ce8e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432" status: 200 len: 1365 microversion: 2.1 time: 0.154284 Sep 03 03:54:40.695238 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 386/774] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:40 2022] GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:40.744254 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-6cbdd847-c287-42d5-9de6-98c8d5d1596f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:40.745141 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-6cbdd847-c287-42d5-9de6-98c8d5d1596f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:40.751769 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6cbdd847-c287-42d5-9de6-98c8d5d1596f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:40.752323 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6cbdd847-c287-42d5-9de6-98c8d5d1596f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:40.752847 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6cbdd847-c287-42d5-9de6-98c8d5d1596f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:40.753607 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6cbdd847-c287-42d5-9de6-98c8d5d1596f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:40.754126 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6cbdd847-c287-42d5-9de6-98c8d5d1596f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:40.754615 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6cbdd847-c287-42d5-9de6-98c8d5d1596f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:40.893671 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-6cbdd847-c287-42d5-9de6-98c8d5d1596f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:40.901966 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-6cbdd847-c287-42d5-9de6-98c8d5d1596f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:40.903449 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-6cbdd847-c287-42d5-9de6-98c8d5d1596f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:40.904603 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-6cbdd847-c287-42d5-9de6-98c8d5d1596f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1723 microversion: 2.20 time: 0.164774 Sep 03 03:54:40.905160 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 389/775] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:54:40 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:54:41.716769 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-b6181300-c22a-4316-90b3-718f08605184 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:41.717489 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-b6181300-c22a-4316-90b3-718f08605184 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: d1d08b5f-9032-4848-ba25-122cd62f1432] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:41.724371 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b6181300-c22a-4316-90b3-718f08605184 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:41.725233 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b6181300-c22a-4316-90b3-718f08605184 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:41.725741 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b6181300-c22a-4316-90b3-718f08605184 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:41.726537 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b6181300-c22a-4316-90b3-718f08605184 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:41.727144 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b6181300-c22a-4316-90b3-718f08605184 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:41.727605 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b6181300-c22a-4316-90b3-718f08605184 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:41.870880 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-b6181300-c22a-4316-90b3-718f08605184 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:41.885911 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-b6181300-c22a-4316-90b3-718f08605184 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432" status: 200 len: 1365 microversion: 2.1 time: 0.172826 Sep 03 03:54:41.886483 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 387/776] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:41 2022] GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:41.930159 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-82d0f3d2-9231-4f81-9603-ad44396e3fef tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:41.930781 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-82d0f3d2-9231-4f81-9603-ad44396e3fef tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:41.937661 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-82d0f3d2-9231-4f81-9603-ad44396e3fef tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:41.938342 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-82d0f3d2-9231-4f81-9603-ad44396e3fef tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:41.938790 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-82d0f3d2-9231-4f81-9603-ad44396e3fef tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:41.939518 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-82d0f3d2-9231-4f81-9603-ad44396e3fef tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:41.940065 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-82d0f3d2-9231-4f81-9603-ad44396e3fef tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:41.940565 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-82d0f3d2-9231-4f81-9603-ad44396e3fef tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:42.079566 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-82d0f3d2-9231-4f81-9603-ad44396e3fef tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:42.088023 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-82d0f3d2-9231-4f81-9603-ad44396e3fef tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:42.089472 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-82d0f3d2-9231-4f81-9603-ad44396e3fef tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:42.090636 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-82d0f3d2-9231-4f81-9603-ad44396e3fef tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1723 microversion: 2.20 time: 0.164773 Sep 03 03:54:42.091200 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 390/777] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:54:41 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:54:42.908308 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-1c9a5328-f9b4-454f-aebc-6427f485735a tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:42.908852 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-1c9a5328-f9b4-454f-aebc-6427f485735a tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: d1d08b5f-9032-4848-ba25-122cd62f1432] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:42.915750 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1c9a5328-f9b4-454f-aebc-6427f485735a tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:42.916232 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1c9a5328-f9b4-454f-aebc-6427f485735a tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:42.916653 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1c9a5328-f9b4-454f-aebc-6427f485735a tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:42.917342 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1c9a5328-f9b4-454f-aebc-6427f485735a tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:42.917781 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1c9a5328-f9b4-454f-aebc-6427f485735a tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:42.918210 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1c9a5328-f9b4-454f-aebc-6427f485735a tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:43.047273 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-1c9a5328-f9b4-454f-aebc-6427f485735a tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:43.055083 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-1c9a5328-f9b4-454f-aebc-6427f485735a tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432" status: 200 len: 1365 microversion: 2.1 time: 0.150689 Sep 03 03:54:43.055646 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 388/778] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:42 2022] GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:43.116115 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-03911543-438d-4688-8673-3819a15c0443 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:43.116718 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-03911543-438d-4688-8673-3819a15c0443 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:43.124046 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-03911543-438d-4688-8673-3819a15c0443 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:43.124518 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-03911543-438d-4688-8673-3819a15c0443 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:43.125013 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-03911543-438d-4688-8673-3819a15c0443 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:43.125862 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-03911543-438d-4688-8673-3819a15c0443 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:43.126304 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-03911543-438d-4688-8673-3819a15c0443 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:43.126715 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-03911543-438d-4688-8673-3819a15c0443 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:43.265999 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-03911543-438d-4688-8673-3819a15c0443 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:43.275442 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-03911543-438d-4688-8673-3819a15c0443 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:43.276889 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-03911543-438d-4688-8673-3819a15c0443 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:43.278054 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-03911543-438d-4688-8673-3819a15c0443 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1744 microversion: 2.20 time: 0.165885 Sep 03 03:54:43.278654 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 391/779] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:54:43 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:54:44.082010 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-0920dd3a-b418-4211-b71c-cf22a89b9683 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:44.082973 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-0920dd3a-b418-4211-b71c-cf22a89b9683 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: d1d08b5f-9032-4848-ba25-122cd62f1432] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:44.094108 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0920dd3a-b418-4211-b71c-cf22a89b9683 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:44.094988 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0920dd3a-b418-4211-b71c-cf22a89b9683 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:44.095709 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0920dd3a-b418-4211-b71c-cf22a89b9683 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:44.096847 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0920dd3a-b418-4211-b71c-cf22a89b9683 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:44.097631 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0920dd3a-b418-4211-b71c-cf22a89b9683 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:44.098291 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0920dd3a-b418-4211-b71c-cf22a89b9683 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:44.238668 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-0920dd3a-b418-4211-b71c-cf22a89b9683 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:44.246763 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-0920dd3a-b418-4211-b71c-cf22a89b9683 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432" status: 200 len: 1365 microversion: 2.1 time: 0.171367 Sep 03 03:54:44.247392 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 389/780] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:44 2022] GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:44.305768 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-d3ae6278-9850-4eed-9163-ea4d3f7f864a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:44.306426 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-d3ae6278-9850-4eed-9163-ea4d3f7f864a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:44.313185 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d3ae6278-9850-4eed-9163-ea4d3f7f864a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:44.313754 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d3ae6278-9850-4eed-9163-ea4d3f7f864a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:44.314217 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d3ae6278-9850-4eed-9163-ea4d3f7f864a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:44.314991 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d3ae6278-9850-4eed-9163-ea4d3f7f864a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:44.315501 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d3ae6278-9850-4eed-9163-ea4d3f7f864a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:44.315996 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d3ae6278-9850-4eed-9163-ea4d3f7f864a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:44.448733 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-d3ae6278-9850-4eed-9163-ea4d3f7f864a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:44.457894 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-d3ae6278-9850-4eed-9163-ea4d3f7f864a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:44.459462 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-d3ae6278-9850-4eed-9163-ea4d3f7f864a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:44.460788 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-d3ae6278-9850-4eed-9163-ea4d3f7f864a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1744 microversion: 2.20 time: 0.158976 Sep 03 03:54:44.462170 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 392/781] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:54:44 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:54:45.270037 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-80e9e04b-bcf2-4c6e-9c76-7d601308128d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:45.270728 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-80e9e04b-bcf2-4c6e-9c76-7d601308128d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: d1d08b5f-9032-4848-ba25-122cd62f1432] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:45.277525 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-80e9e04b-bcf2-4c6e-9c76-7d601308128d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:45.278011 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-80e9e04b-bcf2-4c6e-9c76-7d601308128d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:45.278411 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-80e9e04b-bcf2-4c6e-9c76-7d601308128d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:45.279183 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-80e9e04b-bcf2-4c6e-9c76-7d601308128d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:45.279638 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-80e9e04b-bcf2-4c6e-9c76-7d601308128d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:45.280054 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-80e9e04b-bcf2-4c6e-9c76-7d601308128d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:45.407616 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-80e9e04b-bcf2-4c6e-9c76-7d601308128d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:45.415398 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-80e9e04b-bcf2-4c6e-9c76-7d601308128d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432" status: 200 len: 1365 microversion: 2.1 time: 0.149361 Sep 03 03:54:45.415971 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 390/782] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:45 2022] GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:45.490022 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-7a7d09f6-fc59-4637-b8c6-fdf677f5e529 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:45.490792 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-7a7d09f6-fc59-4637-b8c6-fdf677f5e529 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:45.499328 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7a7d09f6-fc59-4637-b8c6-fdf677f5e529 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:45.499847 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7a7d09f6-fc59-4637-b8c6-fdf677f5e529 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:45.500498 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7a7d09f6-fc59-4637-b8c6-fdf677f5e529 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:45.501115 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7a7d09f6-fc59-4637-b8c6-fdf677f5e529 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:45.501589 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7a7d09f6-fc59-4637-b8c6-fdf677f5e529 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:45.502010 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7a7d09f6-fc59-4637-b8c6-fdf677f5e529 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:45.654496 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-7a7d09f6-fc59-4637-b8c6-fdf677f5e529 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:45.663227 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-7a7d09f6-fc59-4637-b8c6-fdf677f5e529 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:45.665509 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-7a7d09f6-fc59-4637-b8c6-fdf677f5e529 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:45.666959 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-7a7d09f6-fc59-4637-b8c6-fdf677f5e529 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1744 microversion: 2.20 time: 0.181585 Sep 03 03:54:45.667516 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 393/783] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:54:45 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1744 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:54:46.438433 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-0ee7c198-df98-44aa-b25f-b6d3c7c3fe90 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:46.440141 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-0ee7c198-df98-44aa-b25f-b6d3c7c3fe90 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: d1d08b5f-9032-4848-ba25-122cd62f1432] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:46.448229 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0ee7c198-df98-44aa-b25f-b6d3c7c3fe90 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:46.449007 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0ee7c198-df98-44aa-b25f-b6d3c7c3fe90 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:46.450289 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0ee7c198-df98-44aa-b25f-b6d3c7c3fe90 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:46.451392 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0ee7c198-df98-44aa-b25f-b6d3c7c3fe90 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:46.452083 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0ee7c198-df98-44aa-b25f-b6d3c7c3fe90 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:46.452734 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0ee7c198-df98-44aa-b25f-b6d3c7c3fe90 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:46.670085 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-0ee7c198-df98-44aa-b25f-b6d3c7c3fe90 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:46.681896 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-0ee7c198-df98-44aa-b25f-b6d3c7c3fe90 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432" status: 200 len: 1365 microversion: 2.1 time: 0.247800 Sep 03 03:54:46.682709 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 391/784] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:46 2022] GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432 => generated 1365 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:46.692026 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-7be5c0c2-3d72-47ac-9de7-aa5fd1e702c3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:46.692619 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-7be5c0c2-3d72-47ac-9de7-aa5fd1e702c3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:46.702941 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7be5c0c2-3d72-47ac-9de7-aa5fd1e702c3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:46.703689 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7be5c0c2-3d72-47ac-9de7-aa5fd1e702c3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:46.704120 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7be5c0c2-3d72-47ac-9de7-aa5fd1e702c3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:46.704825 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7be5c0c2-3d72-47ac-9de7-aa5fd1e702c3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:46.705273 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7be5c0c2-3d72-47ac-9de7-aa5fd1e702c3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:46.705692 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7be5c0c2-3d72-47ac-9de7-aa5fd1e702c3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:46.742380 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-12550eb1-b6bf-4945-bcf9-725ec2adad96 req-86ef16a2-d4dc-48cf-88a9-322aa81a3cea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1d08b5f-9032-4848-ba25-122cd62f1432", "name": "network-vif-plugged", "status": "completed", "tag": "4369d0d8-6566-4456-8e12-b1fef3c45df0"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:54:46.774466 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-12550eb1-b6bf-4945-bcf9-725ec2adad96 req-86ef16a2-d4dc-48cf-88a9-322aa81a3cea service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:46.775244 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-12550eb1-b6bf-4945-bcf9-725ec2adad96 req-86ef16a2-d4dc-48cf-88a9-322aa81a3cea service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:46.775681 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-12550eb1-b6bf-4945-bcf9-725ec2adad96 req-86ef16a2-d4dc-48cf-88a9-322aa81a3cea service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:46.822631 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-12550eb1-b6bf-4945-bcf9-725ec2adad96 req-86ef16a2-d4dc-48cf-88a9-322aa81a3cea service nova] Creating event network-vif-plugged:4369d0d8-6566-4456-8e12-b1fef3c45df0 for instance d1d08b5f-9032-4848-ba25-122cd62f1432 on hv-cinder-79966 Sep 03 03:54:46.847736 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-12550eb1-b6bf-4945-bcf9-725ec2adad96 req-86ef16a2-d4dc-48cf-88a9-322aa81a3cea service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109424 Sep 03 03:54:46.849017 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 392/785] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:54:46.900168 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-7be5c0c2-3d72-47ac-9de7-aa5fd1e702c3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:46.910464 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-7be5c0c2-3d72-47ac-9de7-aa5fd1e702c3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:46.912263 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-7be5c0c2-3d72-47ac-9de7-aa5fd1e702c3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:46.915036 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-7be5c0c2-3d72-47ac-9de7-aa5fd1e702c3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1739 microversion: 2.20 time: 0.226730 Sep 03 03:54:46.916455 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 394/786] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:54:46 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:54:47.709140 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-9a8d5842-1437-4380-97ea-658d34f9994e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:47.710541 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-9a8d5842-1437-4380-97ea-658d34f9994e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: d1d08b5f-9032-4848-ba25-122cd62f1432] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:47.716511 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell0:SELECT=2 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:54:47.717237 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell0:SELECT=10 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:54:47.719758 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9a8d5842-1437-4380-97ea-658d34f9994e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:47.721094 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9a8d5842-1437-4380-97ea-658d34f9994e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:47.721754 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9a8d5842-1437-4380-97ea-658d34f9994e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:47.722694 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9a8d5842-1437-4380-97ea-658d34f9994e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:47.723595 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9a8d5842-1437-4380-97ea-658d34f9994e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:47.724237 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9a8d5842-1437-4380-97ea-658d34f9994e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:47.906648 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-9a8d5842-1437-4380-97ea-658d34f9994e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:47.915455 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-9a8d5842-1437-4380-97ea-658d34f9994e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432" status: 200 len: 1365 microversion: 2.1 time: 0.214099 Sep 03 03:54:47.918228 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 393/787] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:47 2022] GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432 => generated 1365 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:47.939544 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell0:SELECT=2 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:54:47.945142 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-aacd59f9-1547-4807-8143-cd59d2523dbb tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:47.947230 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-aacd59f9-1547-4807-8143-cd59d2523dbb tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:47.957796 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-aacd59f9-1547-4807-8143-cd59d2523dbb tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:47.957796 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-aacd59f9-1547-4807-8143-cd59d2523dbb tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:47.958443 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-aacd59f9-1547-4807-8143-cd59d2523dbb tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:47.959520 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-aacd59f9-1547-4807-8143-cd59d2523dbb tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:47.960414 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-aacd59f9-1547-4807-8143-cd59d2523dbb tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:47.961404 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-aacd59f9-1547-4807-8143-cd59d2523dbb tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:48.133733 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-aacd59f9-1547-4807-8143-cd59d2523dbb tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:48.143553 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-aacd59f9-1547-4807-8143-cd59d2523dbb tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:48.145105 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-aacd59f9-1547-4807-8143-cd59d2523dbb tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:48.146470 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-aacd59f9-1547-4807-8143-cd59d2523dbb tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1739 microversion: 2.20 time: 0.207815 Sep 03 03:54:48.147522 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 395/788] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:54:47 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:54:48.942125 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-e76c1d0e-3f16-4bdb-822c-ba48ecd9a079 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:48.943904 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-e76c1d0e-3f16-4bdb-822c-ba48ecd9a079 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: d1d08b5f-9032-4848-ba25-122cd62f1432] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:48.951633 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e76c1d0e-3f16-4bdb-822c-ba48ecd9a079 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:48.954032 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e76c1d0e-3f16-4bdb-822c-ba48ecd9a079 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:48.955357 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e76c1d0e-3f16-4bdb-822c-ba48ecd9a079 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:48.957888 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e76c1d0e-3f16-4bdb-822c-ba48ecd9a079 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:48.958615 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e76c1d0e-3f16-4bdb-822c-ba48ecd9a079 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:48.959605 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e76c1d0e-3f16-4bdb-822c-ba48ecd9a079 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:49.071794 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-0e807ef1-6f1c-430a-b6ee-87566d677324 req-66a04e28-0499-4c69-957d-95bf65943a4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc53cf40-e9bf-4403-92b0-7bae49adae43", "name": "network-vif-plugged", "status": "completed", "tag": "1f618203-8c7d-4d80-8d91-954bafd0d268"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:54:49.082750 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-0e807ef1-6f1c-430a-b6ee-87566d677324 req-66a04e28-0499-4c69-957d-95bf65943a4a service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:49.083261 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-0e807ef1-6f1c-430a-b6ee-87566d677324 req-66a04e28-0499-4c69-957d-95bf65943a4a service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:49.083687 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-0e807ef1-6f1c-430a-b6ee-87566d677324 req-66a04e28-0499-4c69-957d-95bf65943a4a service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:49.095681 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-0e807ef1-6f1c-430a-b6ee-87566d677324 req-66a04e28-0499-4c69-957d-95bf65943a4a service nova] Creating event network-vif-plugged:1f618203-8c7d-4d80-8d91-954bafd0d268 for instance cc53cf40-e9bf-4403-92b0-7bae49adae43 on hv-cinder-79966 Sep 03 03:54:49.100758 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-0e807ef1-6f1c-430a-b6ee-87566d677324 req-66a04e28-0499-4c69-957d-95bf65943a4a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.236563 Sep 03 03:54:49.101934 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 394/789] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:54:49.155706 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-e76c1d0e-3f16-4bdb-822c-ba48ecd9a079 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:49.157961 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:54:49.166072 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-e76c1d0e-3f16-4bdb-822c-ba48ecd9a079 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432" status: 200 len: 1554 microversion: 2.1 time: 0.228270 Sep 03 03:54:49.172461 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-d9ebd87c-e1e0-4c70-a7e5-c5c2e82c8281 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:49.173486 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-d9ebd87c-e1e0-4c70-a7e5-c5c2e82c8281 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:49.183088 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 396/790] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:48 2022] GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432 => generated 1554 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:54:49.185542 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d9ebd87c-e1e0-4c70-a7e5-c5c2e82c8281 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:49.186279 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d9ebd87c-e1e0-4c70-a7e5-c5c2e82c8281 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:49.186987 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d9ebd87c-e1e0-4c70-a7e5-c5c2e82c8281 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:49.188889 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-23320abb-854b-43d2-875a-53f6235b0d77 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:49.189101 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d9ebd87c-e1e0-4c70-a7e5-c5c2e82c8281 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:49.189742 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d9ebd87c-e1e0-4c70-a7e5-c5c2e82c8281 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:49.190177 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-23320abb-854b-43d2-875a-53f6235b0d77 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: d1d08b5f-9032-4848-ba25-122cd62f1432] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:49.190350 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d9ebd87c-e1e0-4c70-a7e5-c5c2e82c8281 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:49.197610 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-23320abb-854b-43d2-875a-53f6235b0d77 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:49.198342 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-23320abb-854b-43d2-875a-53f6235b0d77 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:49.198989 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-23320abb-854b-43d2-875a-53f6235b0d77 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:49.199901 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-23320abb-854b-43d2-875a-53f6235b0d77 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:49.200507 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-23320abb-854b-43d2-875a-53f6235b0d77 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:49.201079 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-23320abb-854b-43d2-875a-53f6235b0d77 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:49.314620 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-23320abb-854b-43d2-875a-53f6235b0d77 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.129667 Sep 03 03:54:49.329284 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 397/791] 10.222.0.25 () {58 vars in 1275 bytes} [Sat Sep 3 03:54:49 2022] GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432/os-interface => generated 284 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:54:49.416905 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-d9ebd87c-e1e0-4c70-a7e5-c5c2e82c8281 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:49.427221 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-d9ebd87c-e1e0-4c70-a7e5-c5c2e82c8281 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:49.430420 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-d9ebd87c-e1e0-4c70-a7e5-c5c2e82c8281 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:49.432113 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-d9ebd87c-e1e0-4c70-a7e5-c5c2e82c8281 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1739 microversion: 2.20 time: 0.263932 Sep 03 03:54:49.433378 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 395/792] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:54:49 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1739 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 03:54:50.458359 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-091cb1ab-d801-40fa-a6df-8cb9fb371c4a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:50.458994 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-091cb1ab-d801-40fa-a6df-8cb9fb371c4a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:50.471296 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-091cb1ab-d801-40fa-a6df-8cb9fb371c4a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:50.471783 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-091cb1ab-d801-40fa-a6df-8cb9fb371c4a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:50.472211 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-091cb1ab-d801-40fa-a6df-8cb9fb371c4a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:50.472907 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-091cb1ab-d801-40fa-a6df-8cb9fb371c4a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:50.473347 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-091cb1ab-d801-40fa-a6df-8cb9fb371c4a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:50.473757 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-091cb1ab-d801-40fa-a6df-8cb9fb371c4a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:50.542658 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-3c156d30-a265-4c3a-9488-49eb8422eba0 req-46860fbb-074b-4e55-b517-fe87b6819f67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1d08b5f-9032-4848-ba25-122cd62f1432", "tag": "4369d0d8-6566-4456-8e12-b1fef3c45df0"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:54:50.559146 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-3c156d30-a265-4c3a-9488-49eb8422eba0 req-46860fbb-074b-4e55-b517-fe87b6819f67 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:50.560019 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-3c156d30-a265-4c3a-9488-49eb8422eba0 req-46860fbb-074b-4e55-b517-fe87b6819f67 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:50.561433 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-3c156d30-a265-4c3a-9488-49eb8422eba0 req-46860fbb-074b-4e55-b517-fe87b6819f67 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:50.582785 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-3c156d30-a265-4c3a-9488-49eb8422eba0 req-46860fbb-074b-4e55-b517-fe87b6819f67 service nova] Creating event network-changed:4369d0d8-6566-4456-8e12-b1fef3c45df0 for instance d1d08b5f-9032-4848-ba25-122cd62f1432 on hv-cinder-79966 Sep 03 03:54:50.589767 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-3c156d30-a265-4c3a-9488-49eb8422eba0 req-46860fbb-074b-4e55-b517-fe87b6819f67 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120372 Sep 03 03:54:50.591557 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 396/793] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 03:54:50.629276 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-091cb1ab-d801-40fa-a6df-8cb9fb371c4a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:50.642533 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-091cb1ab-d801-40fa-a6df-8cb9fb371c4a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:50.650625 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-091cb1ab-d801-40fa-a6df-8cb9fb371c4a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:50.653310 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-091cb1ab-d801-40fa-a6df-8cb9fb371c4a tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1739 microversion: 2.20 time: 0.198530 Sep 03 03:54:50.668496 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 398/794] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:54:50 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1739 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:54:51.688396 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-c8fb395c-12d4-492a-8d4a-f48fbbac23f5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:51.690217 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-c8fb395c-12d4-492a-8d4a-f48fbbac23f5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:51.704625 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c8fb395c-12d4-492a-8d4a-f48fbbac23f5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:51.705782 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c8fb395c-12d4-492a-8d4a-f48fbbac23f5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:51.706496 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c8fb395c-12d4-492a-8d4a-f48fbbac23f5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:51.707678 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c8fb395c-12d4-492a-8d4a-f48fbbac23f5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:51.708387 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c8fb395c-12d4-492a-8d4a-f48fbbac23f5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:51.709057 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c8fb395c-12d4-492a-8d4a-f48fbbac23f5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:51.716508 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:54:51.878856 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-c8fb395c-12d4-492a-8d4a-f48fbbac23f5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:51.888860 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-c8fb395c-12d4-492a-8d4a-f48fbbac23f5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:51.892124 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-c8fb395c-12d4-492a-8d4a-f48fbbac23f5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:51.893678 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-c8fb395c-12d4-492a-8d4a-f48fbbac23f5 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1739 microversion: 2.20 time: 0.214204 Sep 03 03:54:51.910839 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 397/795] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:54:51 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1739 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:54:52.931100 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-67919ad4-d6a1-42b0-8ce0-c7cfe6fc9e75 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:52.932423 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-67919ad4-d6a1-42b0-8ce0-c7cfe6fc9e75 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:52.939685 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-67919ad4-d6a1-42b0-8ce0-c7cfe6fc9e75 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:52.940422 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-67919ad4-d6a1-42b0-8ce0-c7cfe6fc9e75 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:52.940581 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-67919ad4-d6a1-42b0-8ce0-c7cfe6fc9e75 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:52.941536 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-67919ad4-d6a1-42b0-8ce0-c7cfe6fc9e75 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:52.941988 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-67919ad4-d6a1-42b0-8ce0-c7cfe6fc9e75 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:52.942410 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-67919ad4-d6a1-42b0-8ce0-c7cfe6fc9e75 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:53.092708 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-67919ad4-d6a1-42b0-8ce0-c7cfe6fc9e75 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:53.101305 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-67919ad4-d6a1-42b0-8ce0-c7cfe6fc9e75 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:53.102728 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-67919ad4-d6a1-42b0-8ce0-c7cfe6fc9e75 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:53.103923 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-67919ad4-d6a1-42b0-8ce0-c7cfe6fc9e75 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1739 microversion: 2.20 time: 0.177557 Sep 03 03:54:53.104808 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 399/796] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:54:52 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:54:54.130418 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-080008c7-6fa4-4236-8a39-0668943d8685 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:54.131814 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-080008c7-6fa4-4236-8a39-0668943d8685 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:54.139947 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-080008c7-6fa4-4236-8a39-0668943d8685 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:54.140441 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-080008c7-6fa4-4236-8a39-0668943d8685 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:54.140877 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-080008c7-6fa4-4236-8a39-0668943d8685 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:54.141580 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-080008c7-6fa4-4236-8a39-0668943d8685 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:54.142027 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-080008c7-6fa4-4236-8a39-0668943d8685 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:54.142642 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-080008c7-6fa4-4236-8a39-0668943d8685 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:54.297235 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-080008c7-6fa4-4236-8a39-0668943d8685 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:54.310564 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-080008c7-6fa4-4236-8a39-0668943d8685 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:54.312409 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-080008c7-6fa4-4236-8a39-0668943d8685 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:54.313579 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-080008c7-6fa4-4236-8a39-0668943d8685 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1739 microversion: 2.20 time: 0.187791 Sep 03 03:54:54.314329 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 398/797] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:54:54 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:54:55.341600 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-118a59bf-abb0-4d8b-a9f6-0220a720e7f1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:55.342308 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-118a59bf-abb0-4d8b-a9f6-0220a720e7f1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:55.349018 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-118a59bf-abb0-4d8b-a9f6-0220a720e7f1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:55.349605 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-118a59bf-abb0-4d8b-a9f6-0220a720e7f1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:55.350102 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-118a59bf-abb0-4d8b-a9f6-0220a720e7f1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:55.351078 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-118a59bf-abb0-4d8b-a9f6-0220a720e7f1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:55.351595 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-118a59bf-abb0-4d8b-a9f6-0220a720e7f1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:55.352098 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-118a59bf-abb0-4d8b-a9f6-0220a720e7f1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:55.511863 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-118a59bf-abb0-4d8b-a9f6-0220a720e7f1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:55.526653 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-118a59bf-abb0-4d8b-a9f6-0220a720e7f1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:55.528175 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-118a59bf-abb0-4d8b-a9f6-0220a720e7f1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:55.529639 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-118a59bf-abb0-4d8b-a9f6-0220a720e7f1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1739 microversion: 2.20 time: 0.191978 Sep 03 03:54:55.530921 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 400/798] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:54:55 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:54:56.558072 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-a061dc68-446e-4707-90ab-73410f6d83b0 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:56.558710 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-a061dc68-446e-4707-90ab-73410f6d83b0 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:56.565675 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a061dc68-446e-4707-90ab-73410f6d83b0 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:56.566248 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a061dc68-446e-4707-90ab-73410f6d83b0 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:56.566697 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a061dc68-446e-4707-90ab-73410f6d83b0 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:56.567387 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a061dc68-446e-4707-90ab-73410f6d83b0 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:56.567836 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a061dc68-446e-4707-90ab-73410f6d83b0 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:56.568250 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a061dc68-446e-4707-90ab-73410f6d83b0 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:56.705547 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a061dc68-446e-4707-90ab-73410f6d83b0 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:56.714292 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a061dc68-446e-4707-90ab-73410f6d83b0 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:56.715859 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a061dc68-446e-4707-90ab-73410f6d83b0 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:56.717001 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-a061dc68-446e-4707-90ab-73410f6d83b0 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1721 microversion: 2.20 time: 0.163081 Sep 03 03:54:56.717556 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 399/799] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:54:56 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:54:57.746292 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-ddd8966a-4c93-43b9-8982-f8c6b90422ee tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:57.747079 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-ddd8966a-4c93-43b9-8982-f8c6b90422ee tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:57.754951 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ddd8966a-4c93-43b9-8982-f8c6b90422ee tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:57.755505 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ddd8966a-4c93-43b9-8982-f8c6b90422ee tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:57.756013 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ddd8966a-4c93-43b9-8982-f8c6b90422ee tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:57.756812 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ddd8966a-4c93-43b9-8982-f8c6b90422ee tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:57.757328 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ddd8966a-4c93-43b9-8982-f8c6b90422ee tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:57.757817 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ddd8966a-4c93-43b9-8982-f8c6b90422ee tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:57.890042 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-ddd8966a-4c93-43b9-8982-f8c6b90422ee tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:57.898168 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-ddd8966a-4c93-43b9-8982-f8c6b90422ee tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:57.899614 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-ddd8966a-4c93-43b9-8982-f8c6b90422ee tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:57.900765 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-ddd8966a-4c93-43b9-8982-f8c6b90422ee tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1721 microversion: 2.20 time: 0.159765 Sep 03 03:54:57.901359 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 401/800] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:54:57 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:54:58.756865 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-ba8ed490-7b3c-4a6e-99e9-9ae213262cf4 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:54:58.757823 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-ba8ed490-7b3c-4a6e-99e9-9ae213262cf4 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:58.773007 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ba8ed490-7b3c-4a6e-99e9-9ae213262cf4 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:58.773824 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ba8ed490-7b3c-4a6e-99e9-9ae213262cf4 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:58.774307 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ba8ed490-7b3c-4a6e-99e9-9ae213262cf4 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:58.775205 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ba8ed490-7b3c-4a6e-99e9-9ae213262cf4 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:58.775652 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ba8ed490-7b3c-4a6e-99e9-9ae213262cf4 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:58.776133 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ba8ed490-7b3c-4a6e-99e9-9ae213262cf4 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:58.803693 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.objects.instance [None req-ba8ed490-7b3c-4a6e-99e9-9ae213262cf4 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lazy-loading 'flavor' on Instance uuid af98ca5b-174f-43f9-a582-af6ad3342b87 {{(pid=132077) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 03:54:58.882044 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-ba8ed490-7b3c-4a6e-99e9-9ae213262cf4 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "POST /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87/action" status: 202 len: 0 microversion: 2.1 time: 0.128938 Sep 03 03:54:58.882713 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 400/801] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Sep 3 03:54:58 2022] POST /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 03:54:58.891929 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-723de34c-8354-462c-a40c-0edc72137ecf tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:58.892557 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-723de34c-8354-462c-a40c-0edc72137ecf tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:58.901146 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-723de34c-8354-462c-a40c-0edc72137ecf tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:58.901629 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-723de34c-8354-462c-a40c-0edc72137ecf tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:58.902039 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-723de34c-8354-462c-a40c-0edc72137ecf tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:58.902899 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-723de34c-8354-462c-a40c-0edc72137ecf tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:58.903361 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-723de34c-8354-462c-a40c-0edc72137ecf tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:58.904338 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-723de34c-8354-462c-a40c-0edc72137ecf tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:58.926314 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-069ab545-bad9-4616-bc21-f0eb8aae4a96 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:58.926994 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-069ab545-bad9-4616-bc21-f0eb8aae4a96 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:58.935605 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-069ab545-bad9-4616-bc21-f0eb8aae4a96 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:58.936174 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-069ab545-bad9-4616-bc21-f0eb8aae4a96 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:58.936669 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-069ab545-bad9-4616-bc21-f0eb8aae4a96 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:58.937445 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-069ab545-bad9-4616-bc21-f0eb8aae4a96 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:58.938527 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-069ab545-bad9-4616-bc21-f0eb8aae4a96 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:58.940464 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-069ab545-bad9-4616-bc21-f0eb8aae4a96 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:59.085191 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-069ab545-bad9-4616-bc21-f0eb8aae4a96 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:59.088198 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-723de34c-8354-462c-a40c-0edc72137ecf tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:59.095850 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-069ab545-bad9-4616-bc21-f0eb8aae4a96 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:59.096815 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-723de34c-8354-462c-a40c-0edc72137ecf tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1568 microversion: 2.1 time: 0.209700 Sep 03 03:54:59.097400 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 402/802] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:54:58 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1568 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:54:59.097987 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-069ab545-bad9-4616-bc21-f0eb8aae4a96 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:54:59.099169 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-069ab545-bad9-4616-bc21-f0eb8aae4a96 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1724 microversion: 2.20 time: 0.177262 Sep 03 03:54:59.099720 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 401/803] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:54:58 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 03:54:59.124067 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-977cb8d3-d67c-429c-9059-680d97a1380d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cbe84466-7f29-4f01-b2b2-773017845835"}} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:54:59.126455 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-977cb8d3-d67c-429c-9059-680d97a1380d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:59.132402 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-977cb8d3-d67c-429c-9059-680d97a1380d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:59.132887 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-977cb8d3-d67c-429c-9059-680d97a1380d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:59.133320 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-977cb8d3-d67c-429c-9059-680d97a1380d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:59.134013 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-977cb8d3-d67c-429c-9059-680d97a1380d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:59.134460 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-977cb8d3-d67c-429c-9059-680d97a1380d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:59.134910 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-977cb8d3-d67c-429c-9059-680d97a1380d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:59.438345 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-977cb8d3-d67c-429c-9059-680d97a1380d tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "POST /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.318146 Sep 03 03:54:59.438978 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 403/804] 10.222.0.25 () {62 vars in 1364 bytes} [Sat Sep 3 03:54:59 2022] POST /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43/os-volume_attachments => generated 188 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 03:54:59.569546 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-8e198470-9ebc-4eaf-93b7-9b6b9a42e3de tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:54:59.570181 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-8e198470-9ebc-4eaf-93b7-9b6b9a42e3de tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:59.572227 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:54:59.577432 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8e198470-9ebc-4eaf-93b7-9b6b9a42e3de tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:59.577914 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8e198470-9ebc-4eaf-93b7-9b6b9a42e3de tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:59.578347 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8e198470-9ebc-4eaf-93b7-9b6b9a42e3de tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:59.579070 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8e198470-9ebc-4eaf-93b7-9b6b9a42e3de tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:59.579521 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8e198470-9ebc-4eaf-93b7-9b6b9a42e3de tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:59.579944 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8e198470-9ebc-4eaf-93b7-9b6b9a42e3de tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:59.838474 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-8e198470-9ebc-4eaf-93b7-9b6b9a42e3de tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43/os-volume_attachments/cbe84466-7f29-4f01-b2b2-773017845835" status: 202 len: 0 microversion: 2.20 time: 0.272944 Sep 03 03:54:59.839106 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 402/805] 10.222.0.25 () {60 vars in 1457 bytes} [Sat Sep 3 03:54:59 2022] DELETE /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43/os-volume_attachments/cbe84466-7f29-4f01-b2b2-773017845835 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 03 03:54:59.904613 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-64852c86-eb40-4674-8489-609c9d724444 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:54:59.905191 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-64852c86-eb40-4674-8489-609c9d724444 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:54:59.911666 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-64852c86-eb40-4674-8489-609c9d724444 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:59.912131 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-64852c86-eb40-4674-8489-609c9d724444 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:59.912551 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-64852c86-eb40-4674-8489-609c9d724444 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:54:59.913222 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-64852c86-eb40-4674-8489-609c9d724444 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:54:59.913702 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-64852c86-eb40-4674-8489-609c9d724444 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:54:59.914092 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-64852c86-eb40-4674-8489-609c9d724444 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:00.051300 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-64852c86-eb40-4674-8489-609c9d724444 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132076) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 03 03:55:00.124529 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-4c0ddd8d-dcd1-4b49-9281-950e965a2af3 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:00.125416 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-4c0ddd8d-dcd1-4b49-9281-950e965a2af3 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:00.133265 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4c0ddd8d-dcd1-4b49-9281-950e965a2af3 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:00.133992 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4c0ddd8d-dcd1-4b49-9281-950e965a2af3 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:00.134426 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4c0ddd8d-dcd1-4b49-9281-950e965a2af3 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:00.135165 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4c0ddd8d-dcd1-4b49-9281-950e965a2af3 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:00.135614 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4c0ddd8d-dcd1-4b49-9281-950e965a2af3 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:00.144610 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4c0ddd8d-dcd1-4b49-9281-950e965a2af3 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:00.148340 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-64852c86-eb40-4674-8489-609c9d724444 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "POST /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43/action" status: 202 len: 0 microversion: 2.20 time: 0.247405 Sep 03 03:55:00.148958 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 404/806] 10.222.0.25 () {62 vars in 1319 bytes} [Sat Sep 3 03:54:59 2022] POST /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 03 03:55:00.165070 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-7127dedd-546d-4bb4-904f-2db963ab3150 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:00.166617 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-7127dedd-546d-4bb4-904f-2db963ab3150 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:00.174357 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7127dedd-546d-4bb4-904f-2db963ab3150 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:00.175248 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7127dedd-546d-4bb4-904f-2db963ab3150 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:00.175903 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7127dedd-546d-4bb4-904f-2db963ab3150 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:00.176971 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7127dedd-546d-4bb4-904f-2db963ab3150 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:00.177637 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7127dedd-546d-4bb4-904f-2db963ab3150 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:00.179070 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7127dedd-546d-4bb4-904f-2db963ab3150 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:00.321034 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-4c0ddd8d-dcd1-4b49-9281-950e965a2af3 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:00.329890 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-4c0ddd8d-dcd1-4b49-9281-950e965a2af3 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1568 microversion: 2.1 time: 0.211839 Sep 03 03:55:00.330463 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 403/807] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:00 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1568 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:55:00.346046 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-7127dedd-546d-4bb4-904f-2db963ab3150 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:00.355450 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-7127dedd-546d-4bb4-904f-2db963ab3150 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:00.357569 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-7127dedd-546d-4bb4-904f-2db963ab3150 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:00.358756 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-7127dedd-546d-4bb4-904f-2db963ab3150 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1672 microversion: 2.20 time: 0.198786 Sep 03 03:55:00.359328 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 405/808] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:55:00 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1672 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:55:00.629806 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-fe2039a4-0403-4154-a3c1-aa06eb9df5d6 req-b8c23da1-31c2-414c-84f2-8c40e86eba83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc53cf40-e9bf-4403-92b0-7bae49adae43", "name": "network-vif-unplugged", "status": "completed", "tag": "1f618203-8c7d-4d80-8d91-954bafd0d268"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:55:00.644389 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-fe2039a4-0403-4154-a3c1-aa06eb9df5d6 req-b8c23da1-31c2-414c-84f2-8c40e86eba83 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:00.645586 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-fe2039a4-0403-4154-a3c1-aa06eb9df5d6 req-b8c23da1-31c2-414c-84f2-8c40e86eba83 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:00.646278 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-fe2039a4-0403-4154-a3c1-aa06eb9df5d6 req-b8c23da1-31c2-414c-84f2-8c40e86eba83 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:00.661970 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.compute.server_external_events [req-fe2039a4-0403-4154-a3c1-aa06eb9df5d6 req-b8c23da1-31c2-414c-84f2-8c40e86eba83 service nova] Unable to find a host for instance cc53cf40-e9bf-4403-92b0-7bae49adae43. Dropping event network-vif-unplugged {{(pid=132077) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 03 03:55:00.662915 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-fe2039a4-0403-4154-a3c1-aa06eb9df5d6 req-b8c23da1-31c2-414c-84f2-8c40e86eba83 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.038176 Sep 03 03:55:00.663862 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 404/809] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 40 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 03 03:55:01.353731 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-78d1aa95-9579-40d4-8897-82f9607d9e0e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:01.354328 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-78d1aa95-9579-40d4-8897-82f9607d9e0e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:01.365763 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-78d1aa95-9579-40d4-8897-82f9607d9e0e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:01.366573 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-78d1aa95-9579-40d4-8897-82f9607d9e0e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:01.367201 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-78d1aa95-9579-40d4-8897-82f9607d9e0e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:01.367886 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-78d1aa95-9579-40d4-8897-82f9607d9e0e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:01.368368 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-78d1aa95-9579-40d4-8897-82f9607d9e0e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:01.368828 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-78d1aa95-9579-40d4-8897-82f9607d9e0e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:01.384289 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-71debc79-ba95-43c6-b988-d53e2fb723b4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:01.384875 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-71debc79-ba95-43c6-b988-d53e2fb723b4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:01.391169 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-71debc79-ba95-43c6-b988-d53e2fb723b4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:01.391685 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-71debc79-ba95-43c6-b988-d53e2fb723b4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:01.392117 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-71debc79-ba95-43c6-b988-d53e2fb723b4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:01.392840 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-71debc79-ba95-43c6-b988-d53e2fb723b4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:01.393287 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-71debc79-ba95-43c6-b988-d53e2fb723b4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:01.393706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-71debc79-ba95-43c6-b988-d53e2fb723b4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:01.523518 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-78d1aa95-9579-40d4-8897-82f9607d9e0e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:01.532511 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-78d1aa95-9579-40d4-8897-82f9607d9e0e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1568 microversion: 2.1 time: 0.183160 Sep 03 03:55:01.533090 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 406/810] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:01 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:55:01.552225 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-71debc79-ba95-43c6-b988-d53e2fb723b4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:01.560635 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-71debc79-ba95-43c6-b988-d53e2fb723b4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:01.562392 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-71debc79-ba95-43c6-b988-d53e2fb723b4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:01.563664 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-71debc79-ba95-43c6-b988-d53e2fb723b4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1674 microversion: 2.20 time: 0.183362 Sep 03 03:55:01.564307 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 405/811] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:55:01 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1674 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 03:55:02.561112 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-75da8a60-07ab-45ed-968b-ad4ed20ab535 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:02.562084 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-75da8a60-07ab-45ed-968b-ad4ed20ab535 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:02.571890 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-75da8a60-07ab-45ed-968b-ad4ed20ab535 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:02.572505 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-75da8a60-07ab-45ed-968b-ad4ed20ab535 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:02.572950 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-75da8a60-07ab-45ed-968b-ad4ed20ab535 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:02.573628 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-75da8a60-07ab-45ed-968b-ad4ed20ab535 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:02.574240 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-75da8a60-07ab-45ed-968b-ad4ed20ab535 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:02.574664 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-75da8a60-07ab-45ed-968b-ad4ed20ab535 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:02.589248 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-0e86feab-fe98-451a-8126-c2437ba6baba tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:02.589880 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-0e86feab-fe98-451a-8126-c2437ba6baba tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:02.596476 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0e86feab-fe98-451a-8126-c2437ba6baba tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:02.596956 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0e86feab-fe98-451a-8126-c2437ba6baba tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:02.597391 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0e86feab-fe98-451a-8126-c2437ba6baba tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:02.598077 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0e86feab-fe98-451a-8126-c2437ba6baba tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:02.598521 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0e86feab-fe98-451a-8126-c2437ba6baba tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:02.598974 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0e86feab-fe98-451a-8126-c2437ba6baba tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:02.709436 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-75da8a60-07ab-45ed-968b-ad4ed20ab535 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:02.717376 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-75da8a60-07ab-45ed-968b-ad4ed20ab535 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1568 microversion: 2.1 time: 0.162870 Sep 03 03:55:02.717952 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 407/812] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:02 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:55:02.736852 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-0e86feab-fe98-451a-8126-c2437ba6baba tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:02.748786 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-0e86feab-fe98-451a-8126-c2437ba6baba tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:02.750919 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-0e86feab-fe98-451a-8126-c2437ba6baba tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:02.752685 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-0e86feab-fe98-451a-8126-c2437ba6baba tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1730 microversion: 2.20 time: 0.167017 Sep 03 03:55:02.753439 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 406/813] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:55:02 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:55:03.745223 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-dbd965be-59dc-416b-92e0-b4509634cead tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:03.745941 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-dbd965be-59dc-416b-92e0-b4509634cead tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:03.755049 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-dbd965be-59dc-416b-92e0-b4509634cead tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:03.755686 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-dbd965be-59dc-416b-92e0-b4509634cead tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:03.756258 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-dbd965be-59dc-416b-92e0-b4509634cead tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:03.757167 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-dbd965be-59dc-416b-92e0-b4509634cead tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:03.757761 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-dbd965be-59dc-416b-92e0-b4509634cead tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:03.758315 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-dbd965be-59dc-416b-92e0-b4509634cead tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:03.779260 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-bd3638e0-005d-4a9a-aaa1-0afe06a5b219 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:03.779859 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-bd3638e0-005d-4a9a-aaa1-0afe06a5b219 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:03.789162 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bd3638e0-005d-4a9a-aaa1-0afe06a5b219 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:03.789718 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bd3638e0-005d-4a9a-aaa1-0afe06a5b219 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:03.790257 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bd3638e0-005d-4a9a-aaa1-0afe06a5b219 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:03.791279 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bd3638e0-005d-4a9a-aaa1-0afe06a5b219 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:03.791817 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bd3638e0-005d-4a9a-aaa1-0afe06a5b219 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:03.792391 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bd3638e0-005d-4a9a-aaa1-0afe06a5b219 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:03.908521 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-dbd965be-59dc-416b-92e0-b4509634cead tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:03.917510 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-dbd965be-59dc-416b-92e0-b4509634cead tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1568 microversion: 2.1 time: 0.178202 Sep 03 03:55:03.918088 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 408/814] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:03 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:55:03.925607 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-bd3638e0-005d-4a9a-aaa1-0afe06a5b219 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:03.934310 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-bd3638e0-005d-4a9a-aaa1-0afe06a5b219 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:03.935760 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-bd3638e0-005d-4a9a-aaa1-0afe06a5b219 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:03.936894 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-bd3638e0-005d-4a9a-aaa1-0afe06a5b219 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1730 microversion: 2.20 time: 0.161510 Sep 03 03:55:03.937448 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 407/815] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:55:03 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:55:04.941315 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-1e8372bc-76ae-4757-8337-e9230266ceea tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:04.941902 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-1e8372bc-76ae-4757-8337-e9230266ceea tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:04.944254 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:55:04.950296 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1e8372bc-76ae-4757-8337-e9230266ceea tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:04.951083 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1e8372bc-76ae-4757-8337-e9230266ceea tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:04.951523 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1e8372bc-76ae-4757-8337-e9230266ceea tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:04.952199 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1e8372bc-76ae-4757-8337-e9230266ceea tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:04.952642 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1e8372bc-76ae-4757-8337-e9230266ceea tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:04.953058 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1e8372bc-76ae-4757-8337-e9230266ceea tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:04.961893 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-ca093674-d1f3-4738-94de-f4ec44aab695 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:04.963194 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-ca093674-d1f3-4738-94de-f4ec44aab695 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:04.970147 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ca093674-d1f3-4738-94de-f4ec44aab695 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:04.970747 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ca093674-d1f3-4738-94de-f4ec44aab695 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:04.971278 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ca093674-d1f3-4738-94de-f4ec44aab695 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:04.971969 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ca093674-d1f3-4738-94de-f4ec44aab695 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:04.972412 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ca093674-d1f3-4738-94de-f4ec44aab695 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:04.973698 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ca093674-d1f3-4738-94de-f4ec44aab695 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:05.112802 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-ca093674-d1f3-4738-94de-f4ec44aab695 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:05.115849 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-1e8372bc-76ae-4757-8337-e9230266ceea tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:05.124715 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-ca093674-d1f3-4738-94de-f4ec44aab695 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:05.125561 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-1e8372bc-76ae-4757-8337-e9230266ceea tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1568 microversion: 2.1 time: 0.188079 Sep 03 03:55:05.128298 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 409/816] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:04 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:55:05.132485 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-ca093674-d1f3-4738-94de-f4ec44aab695 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:05.133735 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-ca093674-d1f3-4738-94de-f4ec44aab695 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1730 microversion: 2.20 time: 0.175966 Sep 03 03:55:05.134413 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 408/817] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:55:04 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 03:55:06.149133 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-0f49bbe2-de5b-4ba4-b07e-3464b7f70017 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:06.149737 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-0f49bbe2-de5b-4ba4-b07e-3464b7f70017 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:06.156650 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0f49bbe2-de5b-4ba4-b07e-3464b7f70017 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:06.157133 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0f49bbe2-de5b-4ba4-b07e-3464b7f70017 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:06.157561 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0f49bbe2-de5b-4ba4-b07e-3464b7f70017 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:06.160431 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-15fa707f-00b7-4a26-8677-29af815d47db tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:06.160913 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0f49bbe2-de5b-4ba4-b07e-3464b7f70017 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:06.161181 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0f49bbe2-de5b-4ba4-b07e-3464b7f70017 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:06.161705 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0f49bbe2-de5b-4ba4-b07e-3464b7f70017 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:06.162416 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-15fa707f-00b7-4a26-8677-29af815d47db tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:06.166874 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:55:06.170466 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-15fa707f-00b7-4a26-8677-29af815d47db tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:06.171104 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-15fa707f-00b7-4a26-8677-29af815d47db tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:06.171755 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-15fa707f-00b7-4a26-8677-29af815d47db tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:06.172578 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-15fa707f-00b7-4a26-8677-29af815d47db tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:06.173087 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-15fa707f-00b7-4a26-8677-29af815d47db tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:06.173573 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-15fa707f-00b7-4a26-8677-29af815d47db tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:06.318640 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-15fa707f-00b7-4a26-8677-29af815d47db tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:06.335816 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-15fa707f-00b7-4a26-8677-29af815d47db tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:06.339069 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-15fa707f-00b7-4a26-8677-29af815d47db tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:06.340315 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-15fa707f-00b7-4a26-8677-29af815d47db tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1730 microversion: 2.20 time: 0.185059 Sep 03 03:55:06.340817 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-0f49bbe2-de5b-4ba4-b07e-3464b7f70017 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:06.341003 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 409/818] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:55:06 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:55:06.355100 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-0f49bbe2-de5b-4ba4-b07e-3464b7f70017 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1568 microversion: 2.1 time: 0.209815 Sep 03 03:55:06.356594 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 410/819] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:06 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1568 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:55:07.368319 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-17b283f3-58ad-4650-98eb-69882904bd9c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:07.369688 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-17b283f3-58ad-4650-98eb-69882904bd9c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:07.380091 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-97cabf8d-0afa-4848-956e-5576042960f0 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:07.381906 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-97cabf8d-0afa-4848-956e-5576042960f0 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:07.383430 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-17b283f3-58ad-4650-98eb-69882904bd9c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:07.387699 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-17b283f3-58ad-4650-98eb-69882904bd9c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:07.388142 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-17b283f3-58ad-4650-98eb-69882904bd9c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:07.388903 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-17b283f3-58ad-4650-98eb-69882904bd9c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:07.389350 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-17b283f3-58ad-4650-98eb-69882904bd9c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:07.389757 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-17b283f3-58ad-4650-98eb-69882904bd9c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:07.392767 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:55:07.394976 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-97cabf8d-0afa-4848-956e-5576042960f0 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:07.395460 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-97cabf8d-0afa-4848-956e-5576042960f0 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:07.395936 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-97cabf8d-0afa-4848-956e-5576042960f0 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:07.396638 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-97cabf8d-0afa-4848-956e-5576042960f0 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:07.397073 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-97cabf8d-0afa-4848-956e-5576042960f0 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:07.397507 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-97cabf8d-0afa-4848-956e-5576042960f0 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:07.545800 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-17b283f3-58ad-4650-98eb-69882904bd9c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:07.555303 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-17b283f3-58ad-4650-98eb-69882904bd9c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:07.556791 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-17b283f3-58ad-4650-98eb-69882904bd9c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:07.557967 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-17b283f3-58ad-4650-98eb-69882904bd9c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1730 microversion: 2.20 time: 0.193850 Sep 03 03:55:07.558737 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 410/820] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:55:07 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1730 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:55:07.602062 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-97cabf8d-0afa-4848-956e-5576042960f0 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:07.605961 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-76400690-4a41-45af-98f7-3d9744bd6b76 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:07.607129 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-76400690-4a41-45af-98f7-3d9744bd6b76 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 3d5f7818-14ce-4b6d-b040-6924c777d0d0] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:07.614135 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-76400690-4a41-45af-98f7-3d9744bd6b76 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:07.614621 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-76400690-4a41-45af-98f7-3d9744bd6b76 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:07.614987 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-97cabf8d-0afa-4848-956e-5576042960f0 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1568 microversion: 2.1 time: 0.239143 Sep 03 03:55:07.615100 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-76400690-4a41-45af-98f7-3d9744bd6b76 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:07.615761 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 411/821] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:07 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1568 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:55:07.615914 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-76400690-4a41-45af-98f7-3d9744bd6b76 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:07.616218 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-76400690-4a41-45af-98f7-3d9744bd6b76 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:07.616773 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-76400690-4a41-45af-98f7-3d9744bd6b76 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:07.651052 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-76400690-4a41-45af-98f7-3d9744bd6b76 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0/ips" status: 200 len: 145 microversion: 2.1 time: 0.049481 Sep 03 03:55:07.655947 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 411/822] 10.222.0.25 () {58 vars in 1248 bytes} [Sat Sep 3 03:55:07 2022] GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0/ips => generated 145 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:55:08.585284 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-811994b6-e6ef-40f9-ae64-05bb139e5e34 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:08.585948 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-811994b6-e6ef-40f9-ae64-05bb139e5e34 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:08.594687 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-811994b6-e6ef-40f9-ae64-05bb139e5e34 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:08.595215 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-811994b6-e6ef-40f9-ae64-05bb139e5e34 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:08.595643 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-811994b6-e6ef-40f9-ae64-05bb139e5e34 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:08.596333 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-811994b6-e6ef-40f9-ae64-05bb139e5e34 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:08.596783 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-811994b6-e6ef-40f9-ae64-05bb139e5e34 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:08.597191 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-811994b6-e6ef-40f9-ae64-05bb139e5e34 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:08.640959 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-5ca734f2-aadc-40ea-bdbc-8a35741be2d7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:08.641730 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-5ca734f2-aadc-40ea-bdbc-8a35741be2d7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:08.649239 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5ca734f2-aadc-40ea-bdbc-8a35741be2d7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:08.650092 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5ca734f2-aadc-40ea-bdbc-8a35741be2d7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:08.650953 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5ca734f2-aadc-40ea-bdbc-8a35741be2d7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:08.652334 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5ca734f2-aadc-40ea-bdbc-8a35741be2d7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:08.653132 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5ca734f2-aadc-40ea-bdbc-8a35741be2d7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:08.654013 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5ca734f2-aadc-40ea-bdbc-8a35741be2d7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:08.772988 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-811994b6-e6ef-40f9-ae64-05bb139e5e34 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:08.785257 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-811994b6-e6ef-40f9-ae64-05bb139e5e34 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:08.786782 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-811994b6-e6ef-40f9-ae64-05bb139e5e34 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:08.788312 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-811994b6-e6ef-40f9-ae64-05bb139e5e34 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1730 microversion: 2.20 time: 0.207295 Sep 03 03:55:08.788930 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 412/823] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:55:08 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1730 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:55:08.813290 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-5ca734f2-aadc-40ea-bdbc-8a35741be2d7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:08.821250 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-5ca734f2-aadc-40ea-bdbc-8a35741be2d7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1568 microversion: 2.1 time: 0.184868 Sep 03 03:55:08.821741 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 412/824] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:08 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:55:09.051604 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-a8e509b2-80bb-480b-8077-d8bdb1eaa5e7 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04980985-88fe-402f-80a5-f7813d08871f"}} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:55:09.054523 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-a8e509b2-80bb-480b-8077-d8bdb1eaa5e7 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 3d5f7818-14ce-4b6d-b040-6924c777d0d0] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:09.060986 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a8e509b2-80bb-480b-8077-d8bdb1eaa5e7 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:09.061466 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a8e509b2-80bb-480b-8077-d8bdb1eaa5e7 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:09.061915 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a8e509b2-80bb-480b-8077-d8bdb1eaa5e7 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:09.062722 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a8e509b2-80bb-480b-8077-d8bdb1eaa5e7 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:09.063198 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a8e509b2-80bb-480b-8077-d8bdb1eaa5e7 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:09.063610 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a8e509b2-80bb-480b-8077-d8bdb1eaa5e7 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:09.815577 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-95f044c2-63c8-4dd3-83a6-6b58a45b22f9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:09.816275 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-95f044c2-63c8-4dd3-83a6-6b58a45b22f9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:09.823325 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-95f044c2-63c8-4dd3-83a6-6b58a45b22f9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:09.824040 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-95f044c2-63c8-4dd3-83a6-6b58a45b22f9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:09.824826 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-95f044c2-63c8-4dd3-83a6-6b58a45b22f9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:09.825605 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-95f044c2-63c8-4dd3-83a6-6b58a45b22f9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:09.826361 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-95f044c2-63c8-4dd3-83a6-6b58a45b22f9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:09.827198 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-95f044c2-63c8-4dd3-83a6-6b58a45b22f9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:09.979942 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-95f044c2-63c8-4dd3-83a6-6b58a45b22f9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:09.989486 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-95f044c2-63c8-4dd3-83a6-6b58a45b22f9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:09.991108 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-95f044c2-63c8-4dd3-83a6-6b58a45b22f9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:09.992392 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-95f044c2-63c8-4dd3-83a6-6b58a45b22f9 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1730 microversion: 2.20 time: 0.181317 Sep 03 03:55:09.993221 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 413/825] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:55:09 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:55:09.997493 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-5b8da7cf-956b-4dc1-87ab-7ad9ddabca0b tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:09.998107 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-5b8da7cf-956b-4dc1-87ab-7ad9ddabca0b tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:10.004651 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5b8da7cf-956b-4dc1-87ab-7ad9ddabca0b tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:10.005392 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5b8da7cf-956b-4dc1-87ab-7ad9ddabca0b tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:10.006146 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5b8da7cf-956b-4dc1-87ab-7ad9ddabca0b tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:10.007406 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5b8da7cf-956b-4dc1-87ab-7ad9ddabca0b tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:10.008310 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5b8da7cf-956b-4dc1-87ab-7ad9ddabca0b tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:10.008890 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5b8da7cf-956b-4dc1-87ab-7ad9ddabca0b tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:10.183952 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-5b8da7cf-956b-4dc1-87ab-7ad9ddabca0b tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:10.194571 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-5b8da7cf-956b-4dc1-87ab-7ad9ddabca0b tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1568 microversion: 2.1 time: 0.200336 Sep 03 03:55:10.206831 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 414/826] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:09 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1568 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:55:11.020951 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-37600587-26bd-4468-9eb3-cac9f6dcdb45 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:11.022441 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-37600587-26bd-4468-9eb3-cac9f6dcdb45 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:11.041252 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-37600587-26bd-4468-9eb3-cac9f6dcdb45 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:11.041754 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-37600587-26bd-4468-9eb3-cac9f6dcdb45 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:11.042185 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-37600587-26bd-4468-9eb3-cac9f6dcdb45 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:11.042925 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-37600587-26bd-4468-9eb3-cac9f6dcdb45 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:11.043371 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-37600587-26bd-4468-9eb3-cac9f6dcdb45 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:11.043788 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-37600587-26bd-4468-9eb3-cac9f6dcdb45 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:11.240619 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-37600587-26bd-4468-9eb3-cac9f6dcdb45 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:11.248888 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-37600587-26bd-4468-9eb3-cac9f6dcdb45 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:11.250375 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-37600587-26bd-4468-9eb3-cac9f6dcdb45 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:11.251567 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-37600587-26bd-4468-9eb3-cac9f6dcdb45 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1730 microversion: 2.20 time: 0.234651 Sep 03 03:55:11.252124 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 415/827] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:55:11 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1730 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:55:11.256994 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-c86846e5-26d8-4078-b704-babf8001e791 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:11.257873 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-c86846e5-26d8-4078-b704-babf8001e791 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:11.265181 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c86846e5-26d8-4078-b704-babf8001e791 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:11.279124 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c86846e5-26d8-4078-b704-babf8001e791 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:11.279772 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c86846e5-26d8-4078-b704-babf8001e791 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:11.280603 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c86846e5-26d8-4078-b704-babf8001e791 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:11.281262 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c86846e5-26d8-4078-b704-babf8001e791 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:11.281692 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c86846e5-26d8-4078-b704-babf8001e791 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:11.443742 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-c86846e5-26d8-4078-b704-babf8001e791 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:11.452762 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-c86846e5-26d8-4078-b704-babf8001e791 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1568 microversion: 2.1 time: 0.199415 Sep 03 03:55:11.453650 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 416/828] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:11 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1568 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:55:12.286985 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-0c0c560a-949c-4130-9e93-f5c67f9a6a76 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:12.286985 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-0c0c560a-949c-4130-9e93-f5c67f9a6a76 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:12.292516 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0c0c560a-949c-4130-9e93-f5c67f9a6a76 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:12.292992 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0c0c560a-949c-4130-9e93-f5c67f9a6a76 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:12.293445 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0c0c560a-949c-4130-9e93-f5c67f9a6a76 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:12.294137 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0c0c560a-949c-4130-9e93-f5c67f9a6a76 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:12.294576 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0c0c560a-949c-4130-9e93-f5c67f9a6a76 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:12.295013 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0c0c560a-949c-4130-9e93-f5c67f9a6a76 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:12.448531 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-0c0c560a-949c-4130-9e93-f5c67f9a6a76 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:12.456995 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-0c0c560a-949c-4130-9e93-f5c67f9a6a76 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:12.458435 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-0c0c560a-949c-4130-9e93-f5c67f9a6a76 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:12.460248 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-0c0c560a-949c-4130-9e93-f5c67f9a6a76 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1730 microversion: 2.20 time: 0.182122 Sep 03 03:55:12.460923 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 417/829] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:55:12 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:55:12.478136 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-012c579d-3a1a-4de1-9ead-4572b9f0e9f7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:12.479319 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-012c579d-3a1a-4de1-9ead-4572b9f0e9f7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:12.489052 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-012c579d-3a1a-4de1-9ead-4572b9f0e9f7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:12.489539 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-012c579d-3a1a-4de1-9ead-4572b9f0e9f7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:12.490160 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-012c579d-3a1a-4de1-9ead-4572b9f0e9f7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:12.491066 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-012c579d-3a1a-4de1-9ead-4572b9f0e9f7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:12.491510 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-012c579d-3a1a-4de1-9ead-4572b9f0e9f7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:12.492157 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-012c579d-3a1a-4de1-9ead-4572b9f0e9f7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:12.637217 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-012c579d-3a1a-4de1-9ead-4572b9f0e9f7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:12.645496 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-012c579d-3a1a-4de1-9ead-4572b9f0e9f7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1568 microversion: 2.1 time: 0.172380 Sep 03 03:55:12.654985 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 418/830] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:12 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:55:13.493717 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-c4e416c7-c50a-4c96-8a1d-822c8395699f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:13.494588 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-c4e416c7-c50a-4c96-8a1d-822c8395699f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:13.502454 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c4e416c7-c50a-4c96-8a1d-822c8395699f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:13.503138 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c4e416c7-c50a-4c96-8a1d-822c8395699f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:13.503734 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c4e416c7-c50a-4c96-8a1d-822c8395699f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:13.504769 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c4e416c7-c50a-4c96-8a1d-822c8395699f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:13.505378 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c4e416c7-c50a-4c96-8a1d-822c8395699f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:13.505846 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c4e416c7-c50a-4c96-8a1d-822c8395699f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:13.661323 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-c4e416c7-c50a-4c96-8a1d-822c8395699f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:13.673554 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-c4e416c7-c50a-4c96-8a1d-822c8395699f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:13.676327 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-c4e416c7-c50a-4c96-8a1d-822c8395699f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:13.679289 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-c4e416c7-c50a-4c96-8a1d-822c8395699f tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1730 microversion: 2.20 time: 0.191418 Sep 03 03:55:13.680308 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 419/831] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:55:13 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:55:13.690305 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-e8a50989-fd2c-4115-8a06-93824be723c7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:13.691180 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-e8a50989-fd2c-4115-8a06-93824be723c7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:13.699528 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e8a50989-fd2c-4115-8a06-93824be723c7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:13.700408 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e8a50989-fd2c-4115-8a06-93824be723c7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:13.701032 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e8a50989-fd2c-4115-8a06-93824be723c7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:13.701750 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e8a50989-fd2c-4115-8a06-93824be723c7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:13.702204 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e8a50989-fd2c-4115-8a06-93824be723c7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:13.702627 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e8a50989-fd2c-4115-8a06-93824be723c7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:13.851295 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-e8a50989-fd2c-4115-8a06-93824be723c7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:13.859995 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-e8a50989-fd2c-4115-8a06-93824be723c7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1568 microversion: 2.1 time: 0.177035 Sep 03 03:55:13.860907 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 420/832] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:13 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:55:14.711460 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-552e3a7b-fc69-4feb-80a9-d8f668fdbcaa tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:14.713225 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-552e3a7b-fc69-4feb-80a9-d8f668fdbcaa tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:14.727173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-552e3a7b-fc69-4feb-80a9-d8f668fdbcaa tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:14.727658 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-552e3a7b-fc69-4feb-80a9-d8f668fdbcaa tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:14.728087 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-552e3a7b-fc69-4feb-80a9-d8f668fdbcaa tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:14.728785 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-552e3a7b-fc69-4feb-80a9-d8f668fdbcaa tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:14.729236 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-552e3a7b-fc69-4feb-80a9-d8f668fdbcaa tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:14.729656 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-552e3a7b-fc69-4feb-80a9-d8f668fdbcaa tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:14.875895 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-552e3a7b-fc69-4feb-80a9-d8f668fdbcaa tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:14.888731 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-552e3a7b-fc69-4feb-80a9-d8f668fdbcaa tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:14.890992 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-552e3a7b-fc69-4feb-80a9-d8f668fdbcaa tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:14.892647 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-552e3a7b-fc69-4feb-80a9-d8f668fdbcaa tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1730 microversion: 2.20 time: 0.188982 Sep 03 03:55:14.893397 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 421/833] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:55:14 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:55:14.897764 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-8e18995a-17dc-44f1-a519-aa9be2a9e956 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:14.898341 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-8e18995a-17dc-44f1-a519-aa9be2a9e956 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:14.904257 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8e18995a-17dc-44f1-a519-aa9be2a9e956 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:14.904735 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8e18995a-17dc-44f1-a519-aa9be2a9e956 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:14.905155 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8e18995a-17dc-44f1-a519-aa9be2a9e956 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:14.905838 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8e18995a-17dc-44f1-a519-aa9be2a9e956 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:14.906281 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8e18995a-17dc-44f1-a519-aa9be2a9e956 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:14.906692 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8e18995a-17dc-44f1-a519-aa9be2a9e956 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:15.034552 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-8e18995a-17dc-44f1-a519-aa9be2a9e956 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:15.046105 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-8e18995a-17dc-44f1-a519-aa9be2a9e956 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1568 microversion: 2.1 time: 0.151445 Sep 03 03:55:15.046864 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 422/834] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:14 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:55:15.926672 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-3a848785-1e33-4ae8-b128-bbc0098dfe51 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:15.927766 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-3a848785-1e33-4ae8-b128-bbc0098dfe51 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:15.936375 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3a848785-1e33-4ae8-b128-bbc0098dfe51 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:15.936857 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3a848785-1e33-4ae8-b128-bbc0098dfe51 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:15.937280 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3a848785-1e33-4ae8-b128-bbc0098dfe51 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:15.937964 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3a848785-1e33-4ae8-b128-bbc0098dfe51 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:15.938404 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3a848785-1e33-4ae8-b128-bbc0098dfe51 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:15.938835 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3a848785-1e33-4ae8-b128-bbc0098dfe51 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:16.071298 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-3a848785-1e33-4ae8-b128-bbc0098dfe51 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:16.079626 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-3a848785-1e33-4ae8-b128-bbc0098dfe51 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:16.081047 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-3a848785-1e33-4ae8-b128-bbc0098dfe51 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:16.082195 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-3a848785-1e33-4ae8-b128-bbc0098dfe51 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1730 microversion: 2.20 time: 0.162347 Sep 03 03:55:16.082752 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 423/835] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:55:15 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:55:16.087204 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-360033a5-ce85-4478-81c6-f6e687617289 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:16.087789 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-360033a5-ce85-4478-81c6-f6e687617289 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:16.093630 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-360033a5-ce85-4478-81c6-f6e687617289 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:16.094112 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-360033a5-ce85-4478-81c6-f6e687617289 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:16.094526 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-360033a5-ce85-4478-81c6-f6e687617289 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:16.095250 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-360033a5-ce85-4478-81c6-f6e687617289 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:16.095690 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-360033a5-ce85-4478-81c6-f6e687617289 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:16.096109 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-360033a5-ce85-4478-81c6-f6e687617289 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:16.226366 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-360033a5-ce85-4478-81c6-f6e687617289 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:16.234958 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-360033a5-ce85-4478-81c6-f6e687617289 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1568 microversion: 2.1 time: 0.151182 Sep 03 03:55:16.235578 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 424/836] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:16 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:55:16.575919 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-a8e509b2-80bb-480b-8077-d8bdb1eaa5e7 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "POST /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.528227 Sep 03 03:55:16.576733 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 413/837] 10.222.0.25 () {60 vars in 1323 bytes} [Sat Sep 3 03:55:09 2022] POST /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0/os-volume_attachments => generated 194 bytes in 7530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:55:17.110044 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-b28256ac-bc34-42a6-a3bf-e24829881a5c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:17.110856 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-b28256ac-bc34-42a6-a3bf-e24829881a5c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:17.118443 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b28256ac-bc34-42a6-a3bf-e24829881a5c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:17.118951 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b28256ac-bc34-42a6-a3bf-e24829881a5c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:17.119379 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b28256ac-bc34-42a6-a3bf-e24829881a5c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:17.120061 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b28256ac-bc34-42a6-a3bf-e24829881a5c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:17.120501 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b28256ac-bc34-42a6-a3bf-e24829881a5c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:17.120921 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b28256ac-bc34-42a6-a3bf-e24829881a5c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:17.260736 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-48e99654-95a5-4655-b088-7f25cd8bb18e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:17.261428 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-48e99654-95a5-4655-b088-7f25cd8bb18e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:17.262339 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-b28256ac-bc34-42a6-a3bf-e24829881a5c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:17.267851 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-48e99654-95a5-4655-b088-7f25cd8bb18e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:17.268347 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-48e99654-95a5-4655-b088-7f25cd8bb18e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:17.268774 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-48e99654-95a5-4655-b088-7f25cd8bb18e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:17.269500 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-48e99654-95a5-4655-b088-7f25cd8bb18e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:17.270081 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-48e99654-95a5-4655-b088-7f25cd8bb18e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:17.270502 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-48e99654-95a5-4655-b088-7f25cd8bb18e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:17.270976 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-b28256ac-bc34-42a6-a3bf-e24829881a5c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:17.272398 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-b28256ac-bc34-42a6-a3bf-e24829881a5c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:17.273687 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-b28256ac-bc34-42a6-a3bf-e24829881a5c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1730 microversion: 2.20 time: 0.168977 Sep 03 03:55:17.274219 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 425/838] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:55:17 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:55:17.427129 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-48e99654-95a5-4655-b088-7f25cd8bb18e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:17.436438 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-48e99654-95a5-4655-b088-7f25cd8bb18e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1568 microversion: 2.1 time: 0.180922 Sep 03 03:55:17.437015 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 414/839] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:17 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:55:18.300949 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-9fcc43e0-ecc4-44f9-ba5b-f5941f63a19c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:18.301586 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-9fcc43e0-ecc4-44f9-ba5b-f5941f63a19c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:18.308458 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9fcc43e0-ecc4-44f9-ba5b-f5941f63a19c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:18.309449 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9fcc43e0-ecc4-44f9-ba5b-f5941f63a19c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:18.309901 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9fcc43e0-ecc4-44f9-ba5b-f5941f63a19c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:18.310678 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9fcc43e0-ecc4-44f9-ba5b-f5941f63a19c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:18.311281 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9fcc43e0-ecc4-44f9-ba5b-f5941f63a19c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:18.311696 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9fcc43e0-ecc4-44f9-ba5b-f5941f63a19c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:18.450663 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-9fcc43e0-ecc4-44f9-ba5b-f5941f63a19c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:18.459770 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-cbf4eade-9f49-4a9e-a8b0-db77f6a23494 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:18.460335 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-9fcc43e0-ecc4-44f9-ba5b-f5941f63a19c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:18.460450 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-cbf4eade-9f49-4a9e-a8b0-db77f6a23494 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:18.461932 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-9fcc43e0-ecc4-44f9-ba5b-f5941f63a19c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:18.463587 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-9fcc43e0-ecc4-44f9-ba5b-f5941f63a19c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1730 microversion: 2.20 time: 0.167341 Sep 03 03:55:18.464319 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 426/840] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:55:18 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:55:18.474960 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cbf4eade-9f49-4a9e-a8b0-db77f6a23494 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:18.474960 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cbf4eade-9f49-4a9e-a8b0-db77f6a23494 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:18.474960 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cbf4eade-9f49-4a9e-a8b0-db77f6a23494 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:18.474960 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cbf4eade-9f49-4a9e-a8b0-db77f6a23494 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:18.475412 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cbf4eade-9f49-4a9e-a8b0-db77f6a23494 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:18.475412 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cbf4eade-9f49-4a9e-a8b0-db77f6a23494 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:18.681794 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-cbf4eade-9f49-4a9e-a8b0-db77f6a23494 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:18.689886 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-cbf4eade-9f49-4a9e-a8b0-db77f6a23494 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1568 microversion: 2.1 time: 0.233804 Sep 03 03:55:18.690372 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 415/841] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:18 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1568 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:55:19.491750 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-ccf5059d-33b9-4750-b1f7-9c748b5bef52 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:19.492427 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-ccf5059d-33b9-4750-b1f7-9c748b5bef52 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:19.499414 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ccf5059d-33b9-4750-b1f7-9c748b5bef52 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:19.499912 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ccf5059d-33b9-4750-b1f7-9c748b5bef52 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:19.500327 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ccf5059d-33b9-4750-b1f7-9c748b5bef52 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:19.501186 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ccf5059d-33b9-4750-b1f7-9c748b5bef52 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:19.501673 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ccf5059d-33b9-4750-b1f7-9c748b5bef52 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:19.502101 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ccf5059d-33b9-4750-b1f7-9c748b5bef52 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:19.506030 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell1:SELECT=100 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:55:19.636674 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-ccf5059d-33b9-4750-b1f7-9c748b5bef52 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:19.644873 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-ccf5059d-33b9-4750-b1f7-9c748b5bef52 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:19.646281 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-ccf5059d-33b9-4750-b1f7-9c748b5bef52 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:19.647448 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-ccf5059d-33b9-4750-b1f7-9c748b5bef52 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1730 microversion: 2.20 time: 0.160122 Sep 03 03:55:19.648001 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 427/842] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:55:19 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:55:19.713445 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-84423e76-b743-47af-8489-391291d65d7c tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:19.714038 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-84423e76-b743-47af-8489-391291d65d7c tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:19.721356 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-84423e76-b743-47af-8489-391291d65d7c tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:19.721835 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-84423e76-b743-47af-8489-391291d65d7c tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:19.722257 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-84423e76-b743-47af-8489-391291d65d7c tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:19.722968 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-84423e76-b743-47af-8489-391291d65d7c tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:19.723411 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-84423e76-b743-47af-8489-391291d65d7c tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:19.723821 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-84423e76-b743-47af-8489-391291d65d7c tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:19.858426 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-84423e76-b743-47af-8489-391291d65d7c tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:19.866688 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-84423e76-b743-47af-8489-391291d65d7c tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1568 microversion: 2.1 time: 0.157268 Sep 03 03:55:19.867288 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 416/843] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:19 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:55:20.674207 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-d24fccd6-cd19-41b5-8a9e-0c653e27e0bd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:20.675499 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-d24fccd6-cd19-41b5-8a9e-0c653e27e0bd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:20.685708 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d24fccd6-cd19-41b5-8a9e-0c653e27e0bd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:20.687189 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d24fccd6-cd19-41b5-8a9e-0c653e27e0bd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:20.687783 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d24fccd6-cd19-41b5-8a9e-0c653e27e0bd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:20.688702 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d24fccd6-cd19-41b5-8a9e-0c653e27e0bd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:20.689306 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d24fccd6-cd19-41b5-8a9e-0c653e27e0bd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:20.689894 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d24fccd6-cd19-41b5-8a9e-0c653e27e0bd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:20.799470 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-81c1b182-f682-4fe4-8b75-d3077ec2aee1 req-ecff69d5-094c-4142-b2db-37bf8f8cbe0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc53cf40-e9bf-4403-92b0-7bae49adae43", "name": "network-vif-plugged", "status": "completed", "tag": "1f618203-8c7d-4d80-8d91-954bafd0d268"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:55:20.819362 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-81c1b182-f682-4fe4-8b75-d3077ec2aee1 req-ecff69d5-094c-4142-b2db-37bf8f8cbe0e service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:20.820051 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-81c1b182-f682-4fe4-8b75-d3077ec2aee1 req-ecff69d5-094c-4142-b2db-37bf8f8cbe0e service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:20.820677 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-81c1b182-f682-4fe4-8b75-d3077ec2aee1 req-ecff69d5-094c-4142-b2db-37bf8f8cbe0e service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:20.837660 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-81c1b182-f682-4fe4-8b75-d3077ec2aee1 req-ecff69d5-094c-4142-b2db-37bf8f8cbe0e service nova] Creating event network-vif-plugged:1f618203-8c7d-4d80-8d91-954bafd0d268 for instance cc53cf40-e9bf-4403-92b0-7bae49adae43 on hv-cinder-79966 Sep 03 03:55:20.859907 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-81c1b182-f682-4fe4-8b75-d3077ec2aee1 req-ecff69d5-094c-4142-b2db-37bf8f8cbe0e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062762 Sep 03 03:55:20.861791 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 417/844] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:55:20.891406 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-425eb785-c9c2-4e25-adfd-1fcb74dc8919 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:20.892450 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-425eb785-c9c2-4e25-adfd-1fcb74dc8919 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:20.903182 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-425eb785-c9c2-4e25-adfd-1fcb74dc8919 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:20.904798 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-425eb785-c9c2-4e25-adfd-1fcb74dc8919 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:20.905947 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-425eb785-c9c2-4e25-adfd-1fcb74dc8919 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:20.907021 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-425eb785-c9c2-4e25-adfd-1fcb74dc8919 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:20.908424 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-425eb785-c9c2-4e25-adfd-1fcb74dc8919 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:20.909224 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-425eb785-c9c2-4e25-adfd-1fcb74dc8919 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:21.179196 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-d24fccd6-cd19-41b5-8a9e-0c653e27e0bd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:21.189879 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-d24fccd6-cd19-41b5-8a9e-0c653e27e0bd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:21.191376 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-d24fccd6-cd19-41b5-8a9e-0c653e27e0bd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:21.192816 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-d24fccd6-cd19-41b5-8a9e-0c653e27e0bd tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1730 microversion: 2.20 time: 0.523038 Sep 03 03:55:21.193383 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 428/845] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:55:20 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1730 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 03:55:21.207015 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-425eb785-c9c2-4e25-adfd-1fcb74dc8919 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:21.215285 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-425eb785-c9c2-4e25-adfd-1fcb74dc8919 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1568 microversion: 2.1 time: 0.328802 Sep 03 03:55:21.216475 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 418/846] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:20 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1568 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:55:22.219857 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-4e0de011-8095-438a-9e2b-8b55415aa012 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:22.220441 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-4e0de011-8095-438a-9e2b-8b55415aa012 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:22.227266 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4e0de011-8095-438a-9e2b-8b55415aa012 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:22.227758 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4e0de011-8095-438a-9e2b-8b55415aa012 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:22.228216 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4e0de011-8095-438a-9e2b-8b55415aa012 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:22.228893 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4e0de011-8095-438a-9e2b-8b55415aa012 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:22.229345 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4e0de011-8095-438a-9e2b-8b55415aa012 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:22.229804 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4e0de011-8095-438a-9e2b-8b55415aa012 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:22.240595 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-18db758d-6d47-4337-8e63-4014c84bfa1e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:22.241820 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-18db758d-6d47-4337-8e63-4014c84bfa1e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:22.247928 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-18db758d-6d47-4337-8e63-4014c84bfa1e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:22.248395 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-18db758d-6d47-4337-8e63-4014c84bfa1e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:22.248881 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-18db758d-6d47-4337-8e63-4014c84bfa1e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:22.249718 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-18db758d-6d47-4337-8e63-4014c84bfa1e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:22.250160 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-18db758d-6d47-4337-8e63-4014c84bfa1e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:22.250578 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-18db758d-6d47-4337-8e63-4014c84bfa1e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:22.381486 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-4e0de011-8095-438a-9e2b-8b55415aa012 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:22.389911 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-4e0de011-8095-438a-9e2b-8b55415aa012 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:22.391355 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-4e0de011-8095-438a-9e2b-8b55415aa012 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:22.392688 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-4e0de011-8095-438a-9e2b-8b55415aa012 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1730 microversion: 2.20 time: 0.176768 Sep 03 03:55:22.393581 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 429/847] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:55:22 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:55:22.395854 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-18db758d-6d47-4337-8e63-4014c84bfa1e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:22.403851 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-18db758d-6d47-4337-8e63-4014c84bfa1e tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1568 microversion: 2.1 time: 0.167161 Sep 03 03:55:22.404510 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 419/848] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:22 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:55:23.419794 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-e736c64f-f86e-4365-bdd9-0c4c2bc3dda1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:23.420564 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-e736c64f-f86e-4365-bdd9-0c4c2bc3dda1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:23.429072 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-7db86aff-5e32-48d4-9ef0-461f34c8fd20 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:23.429782 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e736c64f-f86e-4365-bdd9-0c4c2bc3dda1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:23.429943 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-7db86aff-5e32-48d4-9ef0-461f34c8fd20 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:23.430698 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e736c64f-f86e-4365-bdd9-0c4c2bc3dda1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:23.431753 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e736c64f-f86e-4365-bdd9-0c4c2bc3dda1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:23.432701 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e736c64f-f86e-4365-bdd9-0c4c2bc3dda1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:23.433307 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e736c64f-f86e-4365-bdd9-0c4c2bc3dda1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:23.433877 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e736c64f-f86e-4365-bdd9-0c4c2bc3dda1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:23.438979 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7db86aff-5e32-48d4-9ef0-461f34c8fd20 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:23.439662 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7db86aff-5e32-48d4-9ef0-461f34c8fd20 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:23.440207 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7db86aff-5e32-48d4-9ef0-461f34c8fd20 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:23.441580 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7db86aff-5e32-48d4-9ef0-461f34c8fd20 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:23.442409 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7db86aff-5e32-48d4-9ef0-461f34c8fd20 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:23.443223 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7db86aff-5e32-48d4-9ef0-461f34c8fd20 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:23.574998 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-e736c64f-f86e-4365-bdd9-0c4c2bc3dda1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:23.589746 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-e736c64f-f86e-4365-bdd9-0c4c2bc3dda1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:23.589746 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-e736c64f-f86e-4365-bdd9-0c4c2bc3dda1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:23.590215 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-7db86aff-5e32-48d4-9ef0-461f34c8fd20 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:23.590359 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-e736c64f-f86e-4365-bdd9-0c4c2bc3dda1 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1730 microversion: 2.20 time: 0.171639 Sep 03 03:55:23.590359 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 430/849] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:55:23 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:55:23.595286 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-7db86aff-5e32-48d4-9ef0-461f34c8fd20 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1568 microversion: 2.1 time: 0.171225 Sep 03 03:55:23.596035 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 420/850] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:23 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:55:24.617829 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-85c8a44e-e75d-43e5-9e83-69bd83f47d43 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:24.618557 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-85c8a44e-e75d-43e5-9e83-69bd83f47d43 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:24.619163 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-15b06620-ec5d-462b-8a7f-400f8e75c3ea tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:24.619828 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-15b06620-ec5d-462b-8a7f-400f8e75c3ea tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:24.626048 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-85c8a44e-e75d-43e5-9e83-69bd83f47d43 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:24.626385 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-85c8a44e-e75d-43e5-9e83-69bd83f47d43 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:24.627126 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-85c8a44e-e75d-43e5-9e83-69bd83f47d43 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:24.627900 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-85c8a44e-e75d-43e5-9e83-69bd83f47d43 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:24.628347 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-85c8a44e-e75d-43e5-9e83-69bd83f47d43 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:24.628764 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-85c8a44e-e75d-43e5-9e83-69bd83f47d43 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:24.628922 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-15b06620-ec5d-462b-8a7f-400f8e75c3ea tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:24.629538 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-15b06620-ec5d-462b-8a7f-400f8e75c3ea tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:24.630124 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-15b06620-ec5d-462b-8a7f-400f8e75c3ea tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:24.631005 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-15b06620-ec5d-462b-8a7f-400f8e75c3ea tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:24.631597 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-15b06620-ec5d-462b-8a7f-400f8e75c3ea tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:24.632173 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-15b06620-ec5d-462b-8a7f-400f8e75c3ea tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:24.827335 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-85c8a44e-e75d-43e5-9e83-69bd83f47d43 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:24.847008 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-15b06620-ec5d-462b-8a7f-400f8e75c3ea tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:24.856415 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-15b06620-ec5d-462b-8a7f-400f8e75c3ea tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1568 microversion: 2.1 time: 0.241140 Sep 03 03:55:24.857195 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-85c8a44e-e75d-43e5-9e83-69bd83f47d43 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:24.857559 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 421/851] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:24 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1568 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:55:24.860111 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-85c8a44e-e75d-43e5-9e83-69bd83f47d43 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:24.861503 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-85c8a44e-e75d-43e5-9e83-69bd83f47d43 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1730 microversion: 2.20 time: 0.250129 Sep 03 03:55:24.862140 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 431/852] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:55:24 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1730 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 03:55:25.290146 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-403957ce-1e46-4ee3-9e03-56ce9273c98d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:25.292395 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-403957ce-1e46-4ee3-9e03-56ce9273c98d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 3d5f7818-14ce-4b6d-b040-6924c777d0d0] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:25.298852 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-403957ce-1e46-4ee3-9e03-56ce9273c98d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:25.299333 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-403957ce-1e46-4ee3-9e03-56ce9273c98d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:25.299753 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-403957ce-1e46-4ee3-9e03-56ce9273c98d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:25.300402 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-403957ce-1e46-4ee3-9e03-56ce9273c98d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:25.300873 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-403957ce-1e46-4ee3-9e03-56ce9273c98d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:25.301282 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-403957ce-1e46-4ee3-9e03-56ce9273c98d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:25.336646 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-403957ce-1e46-4ee3-9e03-56ce9273c98d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050309 Sep 03 03:55:25.343070 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 422/853] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Sep 3 03:55:25 2022] GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:55:25.349798 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-b3e037dc-82e7-4f78-b761-d44130d6555c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:25.350285 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-b3e037dc-82e7-4f78-b761-d44130d6555c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 3d5f7818-14ce-4b6d-b040-6924c777d0d0] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:25.356880 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b3e037dc-82e7-4f78-b761-d44130d6555c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:25.357364 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b3e037dc-82e7-4f78-b761-d44130d6555c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:25.357767 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b3e037dc-82e7-4f78-b761-d44130d6555c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:25.358489 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b3e037dc-82e7-4f78-b761-d44130d6555c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:25.359051 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b3e037dc-82e7-4f78-b761-d44130d6555c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:25.359518 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b3e037dc-82e7-4f78-b761-d44130d6555c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:25.389104 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-b3e037dc-82e7-4f78-b761-d44130d6555c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0/os-volume_attachments/04980985-88fe-402f-80a5-f7813d08871f" status: 200 len: 194 microversion: 2.1 time: 0.043794 Sep 03 03:55:25.389687 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 432/854] 10.222.0.25 () {58 vars in 1413 bytes} [Sat Sep 3 03:55:25 2022] GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0/os-volume_attachments/04980985-88fe-402f-80a5-f7813d08871f => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:55:25.883769 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-db8446b7-5d05-4915-a5b4-3ed6d50d9e90 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:25.884506 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-db8446b7-5d05-4915-a5b4-3ed6d50d9e90 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:25.892261 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-db8446b7-5d05-4915-a5b4-3ed6d50d9e90 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:25.893016 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-db8446b7-5d05-4915-a5b4-3ed6d50d9e90 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:25.893431 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-db8446b7-5d05-4915-a5b4-3ed6d50d9e90 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:25.894133 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-db8446b7-5d05-4915-a5b4-3ed6d50d9e90 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:25.894661 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-37e2855d-2809-47f8-8029-b724e501ce10 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:25.895194 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-db8446b7-5d05-4915-a5b4-3ed6d50d9e90 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:25.895194 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-db8446b7-5d05-4915-a5b4-3ed6d50d9e90 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:25.895549 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-37e2855d-2809-47f8-8029-b724e501ce10 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:25.903140 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-37e2855d-2809-47f8-8029-b724e501ce10 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:25.905117 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-37e2855d-2809-47f8-8029-b724e501ce10 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:25.905819 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-37e2855d-2809-47f8-8029-b724e501ce10 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:25.906550 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-37e2855d-2809-47f8-8029-b724e501ce10 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:25.907144 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-37e2855d-2809-47f8-8029-b724e501ce10 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:25.907744 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-37e2855d-2809-47f8-8029-b724e501ce10 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:26.040135 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-db8446b7-5d05-4915-a5b4-3ed6d50d9e90 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:26.048055 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-db8446b7-5d05-4915-a5b4-3ed6d50d9e90 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1509 microversion: 2.1 time: 0.169911 Sep 03 03:55:26.048637 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 423/855] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:25 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:55:26.053441 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-37e2855d-2809-47f8-8029-b724e501ce10 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:26.061695 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-37e2855d-2809-47f8-8029-b724e501ce10 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:26.063144 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-37e2855d-2809-47f8-8029-b724e501ce10 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:26.064317 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-37e2855d-2809-47f8-8029-b724e501ce10 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1717 microversion: 2.20 time: 0.174057 Sep 03 03:55:26.064874 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 433/856] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:55:25 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1717 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 03:55:26.070715 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-75a98938-95b6-4753-bd3d-9f2f73800ef7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:55:26.071378 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-75a98938-95b6-4753-bd3d-9f2f73800ef7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:26.078406 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-75a98938-95b6-4753-bd3d-9f2f73800ef7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:26.078915 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-75a98938-95b6-4753-bd3d-9f2f73800ef7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:26.079628 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-75a98938-95b6-4753-bd3d-9f2f73800ef7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:26.080523 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-75a98938-95b6-4753-bd3d-9f2f73800ef7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:26.080977 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-75a98938-95b6-4753-bd3d-9f2f73800ef7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:26.081390 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-75a98938-95b6-4753-bd3d-9f2f73800ef7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:26.113011 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-75a98938-95b6-4753-bd3d-9f2f73800ef7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132076) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 03 03:55:26.186157 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-75a98938-95b6-4753-bd3d-9f2f73800ef7 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "POST /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87/action" status: 202 len: 0 microversion: 2.1 time: 0.119267 Sep 03 03:55:26.186773 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 424/857] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Sep 3 03:55:26 2022] POST /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 03:55:26.195007 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-fe1dd7cd-1159-409d-a196-a3346556ab4d tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:26.195645 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-fe1dd7cd-1159-409d-a196-a3346556ab4d tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:26.201918 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fe1dd7cd-1159-409d-a196-a3346556ab4d tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:26.202415 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fe1dd7cd-1159-409d-a196-a3346556ab4d tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:26.202824 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fe1dd7cd-1159-409d-a196-a3346556ab4d tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:26.203551 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fe1dd7cd-1159-409d-a196-a3346556ab4d tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:26.203988 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fe1dd7cd-1159-409d-a196-a3346556ab4d tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:26.204492 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fe1dd7cd-1159-409d-a196-a3346556ab4d tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:26.403080 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-fe1dd7cd-1159-409d-a196-a3346556ab4d tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:26.411057 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-fe1dd7cd-1159-409d-a196-a3346556ab4d tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1517 microversion: 2.1 time: 0.219870 Sep 03 03:55:26.411587 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 434/858] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:26 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1517 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:55:26.756965 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-d31dac01-62ee-4f09-9641-12c4a27fa0a2 req-4cbb599a-2cfc-4bfa-9581-448ffe741ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af98ca5b-174f-43f9-a582-af6ad3342b87", "name": "network-vif-unplugged", "status": "completed", "tag": "60723675-08fc-443b-9199-a4d4fdaeb719"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:55:26.761097 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-f5003a72-4161-4c43-b795-47a4fca2820d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17df4cfe-a245-4bc3-a6e2-6aa710353d44"}} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:55:26.764081 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-f5003a72-4161-4c43-b795-47a4fca2820d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 3d5f7818-14ce-4b6d-b040-6924c777d0d0] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:26.772742 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f5003a72-4161-4c43-b795-47a4fca2820d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:26.773221 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f5003a72-4161-4c43-b795-47a4fca2820d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:26.773659 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f5003a72-4161-4c43-b795-47a4fca2820d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:26.774373 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f5003a72-4161-4c43-b795-47a4fca2820d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:26.774752 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-d31dac01-62ee-4f09-9641-12c4a27fa0a2 req-4cbb599a-2cfc-4bfa-9581-448ffe741ee3 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:26.774917 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f5003a72-4161-4c43-b795-47a4fca2820d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:26.775260 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f5003a72-4161-4c43-b795-47a4fca2820d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:26.775843 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-d31dac01-62ee-4f09-9641-12c4a27fa0a2 req-4cbb599a-2cfc-4bfa-9581-448ffe741ee3 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:26.776786 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-d31dac01-62ee-4f09-9641-12c4a27fa0a2 req-4cbb599a-2cfc-4bfa-9581-448ffe741ee3 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:26.784547 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:55:26.803666 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.compute.server_external_events [req-d31dac01-62ee-4f09-9641-12c4a27fa0a2 req-4cbb599a-2cfc-4bfa-9581-448ffe741ee3 service nova] Unable to find a host for instance af98ca5b-174f-43f9-a582-af6ad3342b87. Dropping event network-vif-unplugged {{(pid=132076) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 03 03:55:26.805766 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-d31dac01-62ee-4f09-9641-12c4a27fa0a2 req-4cbb599a-2cfc-4bfa-9581-448ffe741ee3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.052837 Sep 03 03:55:26.806901 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 425/859] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 55 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 03 03:55:27.098915 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-f5003a72-4161-4c43-b795-47a4fca2820d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "POST /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.342495 Sep 03 03:55:27.099539 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 435/860] 10.222.0.25 () {60 vars in 1323 bytes} [Sat Sep 3 03:55:26 2022] POST /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0/os-volume_attachments => generated 194 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:55:27.433991 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-cfac0a53-aa41-46b7-a521-4039d8bb069d tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:27.434650 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-cfac0a53-aa41-46b7-a521-4039d8bb069d tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:27.441890 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cfac0a53-aa41-46b7-a521-4039d8bb069d tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:27.442370 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cfac0a53-aa41-46b7-a521-4039d8bb069d tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:27.442908 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cfac0a53-aa41-46b7-a521-4039d8bb069d tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:27.443647 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cfac0a53-aa41-46b7-a521-4039d8bb069d tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:27.444222 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cfac0a53-aa41-46b7-a521-4039d8bb069d tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:27.444645 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cfac0a53-aa41-46b7-a521-4039d8bb069d tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:27.585957 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-cfac0a53-aa41-46b7-a521-4039d8bb069d tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:27.594390 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-cfac0a53-aa41-46b7-a521-4039d8bb069d tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1519 microversion: 2.1 time: 0.164135 Sep 03 03:55:27.594996 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 426/861] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:27 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:55:28.618821 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-af97daa6-1c23-4c62-9087-32d74c87adf8 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:28.619521 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-af97daa6-1c23-4c62-9087-32d74c87adf8 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:28.625982 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-af97daa6-1c23-4c62-9087-32d74c87adf8 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:28.626451 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-af97daa6-1c23-4c62-9087-32d74c87adf8 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:28.626933 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-af97daa6-1c23-4c62-9087-32d74c87adf8 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:28.627611 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-af97daa6-1c23-4c62-9087-32d74c87adf8 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:28.628037 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-af97daa6-1c23-4c62-9087-32d74c87adf8 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:28.628440 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-af97daa6-1c23-4c62-9087-32d74c87adf8 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:28.769603 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-af97daa6-1c23-4c62-9087-32d74c87adf8 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:28.777642 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-af97daa6-1c23-4c62-9087-32d74c87adf8 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1575 microversion: 2.1 time: 0.163607 Sep 03 03:55:28.778213 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 436/862] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:28 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:55:29.803894 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-82168d62-8910-4226-8931-913b482b2db0 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:29.804478 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-82168d62-8910-4226-8931-913b482b2db0 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:29.811875 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-82168d62-8910-4226-8931-913b482b2db0 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:29.812420 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-82168d62-8910-4226-8931-913b482b2db0 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:29.812855 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-82168d62-8910-4226-8931-913b482b2db0 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:29.813618 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-82168d62-8910-4226-8931-913b482b2db0 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:29.814076 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-82168d62-8910-4226-8931-913b482b2db0 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:29.814490 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-82168d62-8910-4226-8931-913b482b2db0 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:29.958604 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-82168d62-8910-4226-8931-913b482b2db0 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:29.966827 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-82168d62-8910-4226-8931-913b482b2db0 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1575 microversion: 2.1 time: 0.166882 Sep 03 03:55:29.967421 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 427/863] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:29 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:55:30.990884 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-30190855-ff8a-42c5-b4a7-455551f52bbe tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:30.991563 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-30190855-ff8a-42c5-b4a7-455551f52bbe tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:30.994048 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_api:SELECT=70 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:55:31.000858 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-30190855-ff8a-42c5-b4a7-455551f52bbe tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:31.001506 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-30190855-ff8a-42c5-b4a7-455551f52bbe tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:31.002085 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-30190855-ff8a-42c5-b4a7-455551f52bbe tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:31.003003 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-30190855-ff8a-42c5-b4a7-455551f52bbe tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:31.003597 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-30190855-ff8a-42c5-b4a7-455551f52bbe tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:31.004073 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-30190855-ff8a-42c5-b4a7-455551f52bbe tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:31.146768 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-30190855-ff8a-42c5-b4a7-455551f52bbe tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:31.155315 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-30190855-ff8a-42c5-b4a7-455551f52bbe tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1575 microversion: 2.1 time: 0.168008 Sep 03 03:55:31.156168 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 437/864] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:30 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:55:32.183234 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-5b068482-6685-4afc-aafb-a1285e1857e2 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:32.184370 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-5b068482-6685-4afc-aafb-a1285e1857e2 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:32.195366 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5b068482-6685-4afc-aafb-a1285e1857e2 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:32.196162 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5b068482-6685-4afc-aafb-a1285e1857e2 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:32.196866 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5b068482-6685-4afc-aafb-a1285e1857e2 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:32.198012 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5b068482-6685-4afc-aafb-a1285e1857e2 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:32.198754 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5b068482-6685-4afc-aafb-a1285e1857e2 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:32.199497 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5b068482-6685-4afc-aafb-a1285e1857e2 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:32.340473 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-5b068482-6685-4afc-aafb-a1285e1857e2 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:32.348659 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-5b068482-6685-4afc-aafb-a1285e1857e2 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1575 microversion: 2.1 time: 0.171921 Sep 03 03:55:32.349223 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 428/865] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:32 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:55:33.372369 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-2aa6f8ba-e24e-4d11-84e7-e03c380c129f tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:33.373537 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-2aa6f8ba-e24e-4d11-84e7-e03c380c129f tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:33.380384 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2aa6f8ba-e24e-4d11-84e7-e03c380c129f tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:33.380868 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2aa6f8ba-e24e-4d11-84e7-e03c380c129f tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:33.381477 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2aa6f8ba-e24e-4d11-84e7-e03c380c129f tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:33.382207 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2aa6f8ba-e24e-4d11-84e7-e03c380c129f tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:33.382654 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2aa6f8ba-e24e-4d11-84e7-e03c380c129f tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:33.383102 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2aa6f8ba-e24e-4d11-84e7-e03c380c129f tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:33.519261 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-2aa6f8ba-e24e-4d11-84e7-e03c380c129f tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:33.527259 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-2aa6f8ba-e24e-4d11-84e7-e03c380c129f tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1575 microversion: 2.1 time: 0.158999 Sep 03 03:55:33.527880 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 438/866] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:33 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:55:34.446684 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-961dc3cd-a206-404d-8573-f4016aa763cf tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:34.447298 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-961dc3cd-a206-404d-8573-f4016aa763cf tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: d1d08b5f-9032-4848-ba25-122cd62f1432] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:34.454064 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-961dc3cd-a206-404d-8573-f4016aa763cf tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:34.454542 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-961dc3cd-a206-404d-8573-f4016aa763cf tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:34.455114 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-961dc3cd-a206-404d-8573-f4016aa763cf tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:34.455798 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-961dc3cd-a206-404d-8573-f4016aa763cf tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:34.456244 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-961dc3cd-a206-404d-8573-f4016aa763cf tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:34.456657 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-961dc3cd-a206-404d-8573-f4016aa763cf tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:34.481898 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-961dc3cd-a206-404d-8573-f4016aa763cf tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432/ips" status: 200 len: 149 microversion: 2.1 time: 0.039073 Sep 03 03:55:34.482454 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 429/867] 10.222.0.25 () {58 vars in 1248 bytes} [Sat Sep 3 03:55:34 2022] GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:55:34.550358 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-1fa03973-a9cf-478c-a327-9b795a3a8a33 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:34.551041 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-1fa03973-a9cf-478c-a327-9b795a3a8a33 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:34.558579 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1fa03973-a9cf-478c-a327-9b795a3a8a33 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:34.559123 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1fa03973-a9cf-478c-a327-9b795a3a8a33 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:34.559534 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1fa03973-a9cf-478c-a327-9b795a3a8a33 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:34.560745 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1fa03973-a9cf-478c-a327-9b795a3a8a33 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:34.561212 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1fa03973-a9cf-478c-a327-9b795a3a8a33 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:34.561789 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1fa03973-a9cf-478c-a327-9b795a3a8a33 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:34.707052 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-1fa03973-a9cf-478c-a327-9b795a3a8a33 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:34.712308 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-1fa03973-a9cf-478c-a327-9b795a3a8a33 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1575 microversion: 2.1 time: 0.165694 Sep 03 03:55:34.713063 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 439/868] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:34 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:55:35.736804 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-01625688-a960-431f-8bc6-888658d45024 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:35.737503 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-01625688-a960-431f-8bc6-888658d45024 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:35.740437 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:55:35.746258 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-01625688-a960-431f-8bc6-888658d45024 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:35.746741 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-01625688-a960-431f-8bc6-888658d45024 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:35.747191 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-01625688-a960-431f-8bc6-888658d45024 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:35.747887 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-01625688-a960-431f-8bc6-888658d45024 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:35.748336 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-01625688-a960-431f-8bc6-888658d45024 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:35.748585 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-b649093e-5b0b-4b53-8323-99fee8a18d8d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:35.749060 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-01625688-a960-431f-8bc6-888658d45024 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:35.750975 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-b649093e-5b0b-4b53-8323-99fee8a18d8d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 3d5f7818-14ce-4b6d-b040-6924c777d0d0] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:35.757615 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b649093e-5b0b-4b53-8323-99fee8a18d8d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:35.758102 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b649093e-5b0b-4b53-8323-99fee8a18d8d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:35.758526 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b649093e-5b0b-4b53-8323-99fee8a18d8d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:35.759235 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b649093e-5b0b-4b53-8323-99fee8a18d8d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:35.759682 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b649093e-5b0b-4b53-8323-99fee8a18d8d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:35.760094 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b649093e-5b0b-4b53-8323-99fee8a18d8d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:35.791684 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-b649093e-5b0b-4b53-8323-99fee8a18d8d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046958 Sep 03 03:55:35.792486 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 440/869] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Sep 3 03:55:35 2022] GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 03:55:35.838213 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-2ee56051-8f73-44dd-98c1-6cd0f0959e90 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d142405-31d4-4e90-9136-3f4bd0707be8"}} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:55:35.840369 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-2ee56051-8f73-44dd-98c1-6cd0f0959e90 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: d1d08b5f-9032-4848-ba25-122cd62f1432] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:35.846399 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2ee56051-8f73-44dd-98c1-6cd0f0959e90 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:35.846916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2ee56051-8f73-44dd-98c1-6cd0f0959e90 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:35.847354 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2ee56051-8f73-44dd-98c1-6cd0f0959e90 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:35.848045 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2ee56051-8f73-44dd-98c1-6cd0f0959e90 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:35.848495 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2ee56051-8f73-44dd-98c1-6cd0f0959e90 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:35.848916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2ee56051-8f73-44dd-98c1-6cd0f0959e90 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:35.894394 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-01625688-a960-431f-8bc6-888658d45024 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:35.902469 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-01625688-a960-431f-8bc6-888658d45024 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1575 microversion: 2.1 time: 0.169683 Sep 03 03:55:35.903062 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 430/870] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:35 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:55:35.933965 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-43531f19-832b-444c-9357-a7802cb27f95 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:35.934448 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-43531f19-832b-444c-9357-a7802cb27f95 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 3d5f7818-14ce-4b6d-b040-6924c777d0d0] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:35.940362 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-43531f19-832b-444c-9357-a7802cb27f95 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:35.940835 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-43531f19-832b-444c-9357-a7802cb27f95 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:35.941260 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-43531f19-832b-444c-9357-a7802cb27f95 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:35.941937 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-43531f19-832b-444c-9357-a7802cb27f95 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:35.942379 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-43531f19-832b-444c-9357-a7802cb27f95 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:35.942789 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-43531f19-832b-444c-9357-a7802cb27f95 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:35.972441 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-43531f19-832b-444c-9357-a7802cb27f95 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0/os-volume_attachments/04980985-88fe-402f-80a5-f7813d08871f" status: 200 len: 194 microversion: 2.1 time: 0.042285 Sep 03 03:55:35.973157 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 431/871] 10.222.0.25 () {58 vars in 1413 bytes} [Sat Sep 3 03:55:35 2022] GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0/os-volume_attachments/04980985-88fe-402f-80a5-f7813d08871f => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:55:35.983871 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-07dbc1f4-be5b-4bfe-928b-1c46262ca868 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:35.984388 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-07dbc1f4-be5b-4bfe-928b-1c46262ca868 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 3d5f7818-14ce-4b6d-b040-6924c777d0d0] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:35.991107 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-07dbc1f4-be5b-4bfe-928b-1c46262ca868 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:35.991599 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-07dbc1f4-be5b-4bfe-928b-1c46262ca868 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:35.992038 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-07dbc1f4-be5b-4bfe-928b-1c46262ca868 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:35.992615 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:55:35.992737 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-07dbc1f4-be5b-4bfe-928b-1c46262ca868 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:35.993206 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-07dbc1f4-be5b-4bfe-928b-1c46262ca868 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:35.993567 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-07dbc1f4-be5b-4bfe-928b-1c46262ca868 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:36.077029 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.objects.instance [None req-07dbc1f4-be5b-4bfe-928b-1c46262ca868 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lazy-loading 'services' on Instance uuid 3d5f7818-14ce-4b6d-b040-6924c777d0d0 {{(pid=132076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 03:55:36.116306 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-2ee56051-8f73-44dd-98c1-6cd0f0959e90 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "POST /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282054 Sep 03 03:55:36.117242 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 441/872] 10.222.0.25 () {60 vars in 1323 bytes} [Sat Sep 3 03:55:35 2022] POST /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:55:36.154154 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-07dbc1f4-be5b-4bfe-928b-1c46262ca868 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0/os-volume_attachments/04980985-88fe-402f-80a5-f7813d08871f" status: 202 len: 0 microversion: 2.1 time: 0.174282 Sep 03 03:55:36.155001 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 432/873] 10.222.0.25 () {58 vars in 1416 bytes} [Sat Sep 3 03:55:35 2022] DELETE /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0/os-volume_attachments/04980985-88fe-402f-80a5-f7813d08871f => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 03 03:55:36.927768 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-a4861c7b-1ee9-4354-9fd5-4b5668c3108a tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:36.928504 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-a4861c7b-1ee9-4354-9fd5-4b5668c3108a tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:36.934738 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a4861c7b-1ee9-4354-9fd5-4b5668c3108a tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:36.935254 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a4861c7b-1ee9-4354-9fd5-4b5668c3108a tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:36.935704 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a4861c7b-1ee9-4354-9fd5-4b5668c3108a tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:36.936395 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a4861c7b-1ee9-4354-9fd5-4b5668c3108a tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:36.936843 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a4861c7b-1ee9-4354-9fd5-4b5668c3108a tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:36.937293 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a4861c7b-1ee9-4354-9fd5-4b5668c3108a tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:37.079435 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a4861c7b-1ee9-4354-9fd5-4b5668c3108a tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:37.087878 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-a4861c7b-1ee9-4354-9fd5-4b5668c3108a tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1575 microversion: 2.1 time: 0.165082 Sep 03 03:55:37.088404 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 442/874] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:36 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:55:38.116750 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-3e3951fe-cfd2-440f-93ed-a08cf3d4ea7f tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:38.117924 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-3e3951fe-cfd2-440f-93ed-a08cf3d4ea7f tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:38.127732 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3e3951fe-cfd2-440f-93ed-a08cf3d4ea7f tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:38.128297 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3e3951fe-cfd2-440f-93ed-a08cf3d4ea7f tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:38.128717 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3e3951fe-cfd2-440f-93ed-a08cf3d4ea7f tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:38.129649 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3e3951fe-cfd2-440f-93ed-a08cf3d4ea7f tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:38.130058 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3e3951fe-cfd2-440f-93ed-a08cf3d4ea7f tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:38.130466 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3e3951fe-cfd2-440f-93ed-a08cf3d4ea7f tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:38.278358 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-3e3951fe-cfd2-440f-93ed-a08cf3d4ea7f tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:38.286473 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-3e3951fe-cfd2-440f-93ed-a08cf3d4ea7f tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1575 microversion: 2.1 time: 0.176898 Sep 03 03:55:38.287348 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 433/875] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:38 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:55:38.903303 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-f131b35c-8069-486d-b9ca-6cc130a8d6ff req-fc95a6d1-bb70-4d39-bdaf-af39e72990ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af98ca5b-174f-43f9-a582-af6ad3342b87", "name": "network-vif-plugged", "status": "completed", "tag": "60723675-08fc-443b-9199-a4d4fdaeb719"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:55:38.918664 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-f131b35c-8069-486d-b9ca-6cc130a8d6ff req-fc95a6d1-bb70-4d39-bdaf-af39e72990ab service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:38.919136 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-f131b35c-8069-486d-b9ca-6cc130a8d6ff req-fc95a6d1-bb70-4d39-bdaf-af39e72990ab service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:38.919624 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-f131b35c-8069-486d-b9ca-6cc130a8d6ff req-fc95a6d1-bb70-4d39-bdaf-af39e72990ab service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:38.932759 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-f131b35c-8069-486d-b9ca-6cc130a8d6ff req-fc95a6d1-bb70-4d39-bdaf-af39e72990ab service nova] Creating event network-vif-plugged:60723675-08fc-443b-9199-a4d4fdaeb719 for instance af98ca5b-174f-43f9-a582-af6ad3342b87 on hv-cinder-79966 Sep 03 03:55:38.938082 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-f131b35c-8069-486d-b9ca-6cc130a8d6ff req-fc95a6d1-bb70-4d39-bdaf-af39e72990ab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042873 Sep 03 03:55:38.938756 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 443/876] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:55:39.309478 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-fe071a2f-1542-432f-8461-4a556c0f0b00 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:39.310161 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-fe071a2f-1542-432f-8461-4a556c0f0b00 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:39.317040 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fe071a2f-1542-432f-8461-4a556c0f0b00 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:39.317605 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fe071a2f-1542-432f-8461-4a556c0f0b00 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:39.318034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fe071a2f-1542-432f-8461-4a556c0f0b00 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:39.318743 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fe071a2f-1542-432f-8461-4a556c0f0b00 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:39.319242 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fe071a2f-1542-432f-8461-4a556c0f0b00 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:39.319693 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fe071a2f-1542-432f-8461-4a556c0f0b00 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:39.457188 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-fe071a2f-1542-432f-8461-4a556c0f0b00 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:39.466448 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-fe071a2f-1542-432f-8461-4a556c0f0b00 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1575 microversion: 2.1 time: 0.160760 Sep 03 03:55:39.467062 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 434/877] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:39 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:55:40.492276 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-1b627c69-bcb7-478b-9943-3d5545319f20 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:40.492962 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-1b627c69-bcb7-478b-9943-3d5545319f20 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:40.499116 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1b627c69-bcb7-478b-9943-3d5545319f20 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:40.499589 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1b627c69-bcb7-478b-9943-3d5545319f20 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:40.500013 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1b627c69-bcb7-478b-9943-3d5545319f20 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:40.500696 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1b627c69-bcb7-478b-9943-3d5545319f20 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:40.501158 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1b627c69-bcb7-478b-9943-3d5545319f20 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:40.501571 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1b627c69-bcb7-478b-9943-3d5545319f20 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:40.635278 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-1b627c69-bcb7-478b-9943-3d5545319f20 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:40.643279 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-1b627c69-bcb7-478b-9943-3d5545319f20 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1562 microversion: 2.1 time: 0.156383 Sep 03 03:55:40.643879 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 444/878] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:40 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:55:51.210621 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-34970d15-5fd9-42b1-9a67-2d7a0baaef17 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-750584759", "imageRef": "0af209bb-870a-4343-a9f9-de05883bb8dd", "flavorRef": "452"}} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:55:51.218235 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_api:SELECT=9 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:55:51.218902 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell1:SELECT=56,nova_cell1:INSERT=1 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:55:51.266375 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.network.neutron [None req-34970d15-5fd9-42b1-9a67-2d7a0baaef17 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] validate_networks() for None {{(pid=132076) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 03:55:51.552896 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-34970d15-5fd9-42b1-9a67-2d7a0baaef17 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Flavor limits 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 03:55:51.553317 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-34970d15-5fd9-42b1-9a67-2d7a0baaef17 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Image limits 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 03:55:51.553778 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-34970d15-5fd9-42b1-9a67-2d7a0baaef17 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Flavor pref 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 03:55:51.554181 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-34970d15-5fd9-42b1-9a67-2d7a0baaef17 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Image pref 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 03:55:51.554581 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-34970d15-5fd9-42b1-9a67-2d7a0baaef17 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 03:55:51.564534 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-34970d15-5fd9-42b1-9a67-2d7a0baaef17 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:51.564951 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-34970d15-5fd9-42b1-9a67-2d7a0baaef17 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:51.565385 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-34970d15-5fd9-42b1-9a67-2d7a0baaef17 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:51.566106 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-34970d15-5fd9-42b1-9a67-2d7a0baaef17 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:51.566560 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-34970d15-5fd9-42b1-9a67-2d7a0baaef17 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:51.567032 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-34970d15-5fd9-42b1-9a67-2d7a0baaef17 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:51.583821 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.quota [None req-34970d15-5fd9-42b1-9a67-2d7a0baaef17 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Getting quotas for project 78f83c7b81a54c9a936f140ca94e3d34. Resources: {'ram', 'instances', 'cores'} {{(pid=132076) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 03:55:51.588200 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.quota [None req-34970d15-5fd9-42b1-9a67-2d7a0baaef17 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Getting quotas for user 5594b2c1a2fd4bf8ad2f1c5d2c05b777 and project 78f83c7b81a54c9a936f140ca94e3d34. Resources: {'ram', 'instances', 'cores'} {{(pid=132076) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 03:55:51.600338 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-34970d15-5fd9-42b1-9a67-2d7a0baaef17 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Going to run 1 instances... {{(pid=132076) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 03:55:51.602579 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-34970d15-5fd9-42b1-9a67-2d7a0baaef17 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] [instance: ed64ff03-ce00-49c3-868e-32a0be3fa6bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0af209bb-870a-4343-a9f9-de05883bb8dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132076) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 03:55:51.647970 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-34970d15-5fd9-42b1-9a67-2d7a0baaef17 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.441247 Sep 03 03:55:51.648637 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 435/879] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Sep 3 03:55:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 03:55:51.659702 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-5afbd75e-7e43-446c-b14c-de15c1844832 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:51.660286 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-5afbd75e-7e43-446c-b14c-de15c1844832 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] [instance: ed64ff03-ce00-49c3-868e-32a0be3fa6bf] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:51.663747 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_api:SELECT=15 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:55:51.664526 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:55:51.718288 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-5afbd75e-7e43-446c-b14c-de15c1844832 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5594b2c1a2fd4bf8ad2f1c5d2c05b777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f83c7b81a54c9a936f140ca94e3d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:51.725335 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-5afbd75e-7e43-446c-b14c-de15c1844832 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] 10.222.0.25 "GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf" status: 200 len: 1214 microversion: 2.1 time: 0.069443 Sep 03 03:55:51.725901 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 445/880] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:51 2022] GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:55:52.751066 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-c62fd493-a18e-497f-9d4c-db3133115559 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:52.751734 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-c62fd493-a18e-497f-9d4c-db3133115559 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] [instance: ed64ff03-ce00-49c3-868e-32a0be3fa6bf] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:52.758951 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c62fd493-a18e-497f-9d4c-db3133115559 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:52.759433 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c62fd493-a18e-497f-9d4c-db3133115559 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:52.759864 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c62fd493-a18e-497f-9d4c-db3133115559 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:52.760548 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c62fd493-a18e-497f-9d4c-db3133115559 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:52.761003 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c62fd493-a18e-497f-9d4c-db3133115559 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:52.761419 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c62fd493-a18e-497f-9d4c-db3133115559 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:52.822208 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-c62fd493-a18e-497f-9d4c-db3133115559 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5594b2c1a2fd4bf8ad2f1c5d2c05b777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f83c7b81a54c9a936f140ca94e3d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:52.830637 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-c62fd493-a18e-497f-9d4c-db3133115559 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] 10.222.0.25 "GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf" status: 200 len: 1218 microversion: 2.1 time: 0.085004 Sep 03 03:55:52.831322 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 436/881] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:52 2022] GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:55:53.857947 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-4ff1f5a7-79ae-4bca-b196-3b29ff70f486 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:53.858974 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-4ff1f5a7-79ae-4bca-b196-3b29ff70f486 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] [instance: ed64ff03-ce00-49c3-868e-32a0be3fa6bf] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:53.867980 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4ff1f5a7-79ae-4bca-b196-3b29ff70f486 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:53.868460 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4ff1f5a7-79ae-4bca-b196-3b29ff70f486 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:53.868884 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4ff1f5a7-79ae-4bca-b196-3b29ff70f486 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:53.869567 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4ff1f5a7-79ae-4bca-b196-3b29ff70f486 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:53.870003 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4ff1f5a7-79ae-4bca-b196-3b29ff70f486 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:53.870415 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4ff1f5a7-79ae-4bca-b196-3b29ff70f486 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:53.936100 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-4ff1f5a7-79ae-4bca-b196-3b29ff70f486 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5594b2c1a2fd4bf8ad2f1c5d2c05b777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f83c7b81a54c9a936f140ca94e3d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:53.943887 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-4ff1f5a7-79ae-4bca-b196-3b29ff70f486 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] 10.222.0.25 "GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf" status: 200 len: 1218 microversion: 2.1 time: 0.092735 Sep 03 03:55:53.944413 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 446/882] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:53 2022] GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:55:54.966892 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-b3046aaf-6c4c-4b37-ba83-08db15b209a7 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:54.967507 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-b3046aaf-6c4c-4b37-ba83-08db15b209a7 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] [instance: ed64ff03-ce00-49c3-868e-32a0be3fa6bf] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:54.975174 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b3046aaf-6c4c-4b37-ba83-08db15b209a7 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:54.975654 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b3046aaf-6c4c-4b37-ba83-08db15b209a7 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:54.976089 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b3046aaf-6c4c-4b37-ba83-08db15b209a7 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:54.976767 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b3046aaf-6c4c-4b37-ba83-08db15b209a7 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:54.977210 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b3046aaf-6c4c-4b37-ba83-08db15b209a7 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:54.977617 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b3046aaf-6c4c-4b37-ba83-08db15b209a7 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:55.039696 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-b3046aaf-6c4c-4b37-ba83-08db15b209a7 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5594b2c1a2fd4bf8ad2f1c5d2c05b777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f83c7b81a54c9a936f140ca94e3d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:55.047366 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-b3046aaf-6c4c-4b37-ba83-08db15b209a7 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] 10.222.0.25 "GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf" status: 200 len: 1218 microversion: 2.1 time: 0.084831 Sep 03 03:55:55.048139 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 437/883] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:54 2022] GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:55:56.077664 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-165e9cc3-ab86-4238-a5df-4e1de743a6c7 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:56.078621 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-165e9cc3-ab86-4238-a5df-4e1de743a6c7 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] [instance: ed64ff03-ce00-49c3-868e-32a0be3fa6bf] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:56.089728 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-165e9cc3-ab86-4238-a5df-4e1de743a6c7 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:56.090528 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-165e9cc3-ab86-4238-a5df-4e1de743a6c7 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:56.091287 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-165e9cc3-ab86-4238-a5df-4e1de743a6c7 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:56.092416 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-165e9cc3-ab86-4238-a5df-4e1de743a6c7 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:56.093158 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-165e9cc3-ab86-4238-a5df-4e1de743a6c7 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:56.093849 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-165e9cc3-ab86-4238-a5df-4e1de743a6c7 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:56.159041 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-165e9cc3-ab86-4238-a5df-4e1de743a6c7 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5594b2c1a2fd4bf8ad2f1c5d2c05b777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f83c7b81a54c9a936f140ca94e3d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:56.166971 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-165e9cc3-ab86-4238-a5df-4e1de743a6c7 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] 10.222.0.25 "GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf" status: 200 len: 1218 microversion: 2.1 time: 0.095831 Sep 03 03:55:56.167586 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 447/884] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:56 2022] GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:55:57.194050 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-bd065b7b-92e6-4916-af0a-4578153e8f3d tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:57.194792 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-bd065b7b-92e6-4916-af0a-4578153e8f3d tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] [instance: ed64ff03-ce00-49c3-868e-32a0be3fa6bf] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:57.206128 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-bd065b7b-92e6-4916-af0a-4578153e8f3d tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:57.206875 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-bd065b7b-92e6-4916-af0a-4578153e8f3d tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:57.207719 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-bd065b7b-92e6-4916-af0a-4578153e8f3d tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:57.210486 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-bd065b7b-92e6-4916-af0a-4578153e8f3d tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:57.210967 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-bd065b7b-92e6-4916-af0a-4578153e8f3d tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:57.211382 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-bd065b7b-92e6-4916-af0a-4578153e8f3d tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:57.550410 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-bd065b7b-92e6-4916-af0a-4578153e8f3d tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5594b2c1a2fd4bf8ad2f1c5d2c05b777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f83c7b81a54c9a936f140ca94e3d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:57.558648 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-bd065b7b-92e6-4916-af0a-4578153e8f3d tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] 10.222.0.25 "GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf" status: 200 len: 1218 microversion: 2.1 time: 0.371441 Sep 03 03:55:57.559349 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 438/885] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:57 2022] GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf => generated 1218 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:55:58.599082 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-c05ee542-0b60-49e2-b369-871473109708 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:58.599082 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-c05ee542-0b60-49e2-b369-871473109708 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] [instance: ed64ff03-ce00-49c3-868e-32a0be3fa6bf] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:58.614020 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c05ee542-0b60-49e2-b369-871473109708 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:58.614516 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c05ee542-0b60-49e2-b369-871473109708 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:58.614977 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c05ee542-0b60-49e2-b369-871473109708 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:58.615690 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c05ee542-0b60-49e2-b369-871473109708 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:58.616291 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c05ee542-0b60-49e2-b369-871473109708 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:58.616837 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c05ee542-0b60-49e2-b369-871473109708 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:58.679694 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-c05ee542-0b60-49e2-b369-871473109708 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5594b2c1a2fd4bf8ad2f1c5d2c05b777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f83c7b81a54c9a936f140ca94e3d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:58.687543 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-c05ee542-0b60-49e2-b369-871473109708 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] 10.222.0.25 "GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf" status: 200 len: 1266 microversion: 2.1 time: 0.109548 Sep 03 03:55:58.688111 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 448/886] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:58 2022] GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf => generated 1266 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:55:58.771751 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-5c251ab3-7244-474f-8970-756de678f35d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:58.772266 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-5c251ab3-7244-474f-8970-756de678f35d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: d1d08b5f-9032-4848-ba25-122cd62f1432] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:58.778617 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5c251ab3-7244-474f-8970-756de678f35d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:58.779137 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5c251ab3-7244-474f-8970-756de678f35d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:58.779564 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5c251ab3-7244-474f-8970-756de678f35d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:58.780377 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5c251ab3-7244-474f-8970-756de678f35d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:58.780822 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5c251ab3-7244-474f-8970-756de678f35d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:58.781235 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5c251ab3-7244-474f-8970-756de678f35d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:58.864604 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.objects.instance [None req-5c251ab3-7244-474f-8970-756de678f35d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lazy-loading 'services' on Instance uuid d1d08b5f-9032-4848-ba25-122cd62f1432 {{(pid=132076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 03:55:58.940912 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-5c251ab3-7244-474f-8970-756de678f35d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432/os-volume_attachments/3d142405-31d4-4e90-9136-3f4bd0707be8" status: 202 len: 0 microversion: 2.1 time: 0.172927 Sep 03 03:55:58.941478 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 439/887] 10.222.0.25 () {58 vars in 1416 bytes} [Sat Sep 3 03:55:58 2022] DELETE /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432/os-volume_attachments/3d142405-31d4-4e90-9136-3f4bd0707be8 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 03:55:58.950253 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-6c8195b0-737e-4354-a3d7-2d0e9bf8dead tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:58.952251 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-6c8195b0-737e-4354-a3d7-2d0e9bf8dead tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: d1d08b5f-9032-4848-ba25-122cd62f1432] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:58.958217 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6c8195b0-737e-4354-a3d7-2d0e9bf8dead tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:58.958686 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6c8195b0-737e-4354-a3d7-2d0e9bf8dead tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:58.959148 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6c8195b0-737e-4354-a3d7-2d0e9bf8dead tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:58.959862 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6c8195b0-737e-4354-a3d7-2d0e9bf8dead tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:58.960306 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6c8195b0-737e-4354-a3d7-2d0e9bf8dead tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:58.960715 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6c8195b0-737e-4354-a3d7-2d0e9bf8dead tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:58.992889 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-6c8195b0-737e-4354-a3d7-2d0e9bf8dead tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046684 Sep 03 03:55:58.993556 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 449/888] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Sep 3 03:55:58 2022] GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 03:55:59.173229 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-4dc16743-ca60-4f53-937d-132027a2825b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:59.175977 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-4dc16743-ca60-4f53-937d-132027a2825b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:59.182386 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4dc16743-ca60-4f53-937d-132027a2825b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:59.183119 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4dc16743-ca60-4f53-937d-132027a2825b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:59.183568 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4dc16743-ca60-4f53-937d-132027a2825b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:59.184356 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4dc16743-ca60-4f53-937d-132027a2825b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:59.184832 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4dc16743-ca60-4f53-937d-132027a2825b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:59.185234 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4dc16743-ca60-4f53-937d-132027a2825b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:59.213828 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-4dc16743-ca60-4f53-937d-132027a2825b tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045549 Sep 03 03:55:59.214386 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 440/889] 10.222.0.25 () {60 vars in 1343 bytes} [Sat Sep 3 03:55:59 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:55:59.277197 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-36ca34bd-078a-4144-b47c-b6f069c66bd4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:59.277737 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-36ca34bd-078a-4144-b47c-b6f069c66bd4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:59.283712 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-36ca34bd-078a-4144-b47c-b6f069c66bd4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:59.284123 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-36ca34bd-078a-4144-b47c-b6f069c66bd4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:59.284547 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-36ca34bd-078a-4144-b47c-b6f069c66bd4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:59.285368 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-36ca34bd-078a-4144-b47c-b6f069c66bd4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:59.285819 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-36ca34bd-078a-4144-b47c-b6f069c66bd4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:59.286236 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-36ca34bd-078a-4144-b47c-b6f069c66bd4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:59.311728 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-36ca34bd-078a-4144-b47c-b6f069c66bd4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Going to try to terminate instance {{(pid=132077) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 03:55:59.405379 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-36ca34bd-078a-4144-b47c-b6f069c66bd4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 204 len: 0 microversion: 2.20 time: 0.131685 Sep 03 03:55:59.406024 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 450/890] 10.222.0.25 () {60 vars in 1280 bytes} [Sat Sep 3 03:55:59 2022] DELETE /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 03 03:55:59.414560 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-fe22a8e5-ee1f-4715-a430-04e2a9ba3618 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:59.415254 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-fe22a8e5-ee1f-4715-a430-04e2a9ba3618 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:59.421188 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fe22a8e5-ee1f-4715-a430-04e2a9ba3618 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:59.421657 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fe22a8e5-ee1f-4715-a430-04e2a9ba3618 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:59.422069 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fe22a8e5-ee1f-4715-a430-04e2a9ba3618 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:59.422773 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fe22a8e5-ee1f-4715-a430-04e2a9ba3618 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:59.423241 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fe22a8e5-ee1f-4715-a430-04e2a9ba3618 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:59.423651 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fe22a8e5-ee1f-4715-a430-04e2a9ba3618 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:59.552470 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-fe22a8e5-ee1f-4715-a430-04e2a9ba3618 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:59.561103 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-fe22a8e5-ee1f-4715-a430-04e2a9ba3618 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:59.562526 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-fe22a8e5-ee1f-4715-a430-04e2a9ba3618 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:59.563693 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-fe22a8e5-ee1f-4715-a430-04e2a9ba3618 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1723 microversion: 2.20 time: 0.153230 Sep 03 03:55:59.564247 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 441/891] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:55:59 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:55:59.667941 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-a93e0517-1a61-45d8-892d-a199a56c3939 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:59.668497 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-a93e0517-1a61-45d8-892d-a199a56c3939 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 3d5f7818-14ce-4b6d-b040-6924c777d0d0] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:59.675032 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a93e0517-1a61-45d8-892d-a199a56c3939 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:59.675536 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a93e0517-1a61-45d8-892d-a199a56c3939 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:59.675935 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a93e0517-1a61-45d8-892d-a199a56c3939 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:59.676618 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a93e0517-1a61-45d8-892d-a199a56c3939 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:59.677061 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a93e0517-1a61-45d8-892d-a199a56c3939 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:59.677477 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a93e0517-1a61-45d8-892d-a199a56c3939 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:59.711250 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-354a55a2-cd4d-4db0-9d7c-7ac1f7a0c908 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:59.711859 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-354a55a2-cd4d-4db0-9d7c-7ac1f7a0c908 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] [instance: ed64ff03-ce00-49c3-868e-32a0be3fa6bf] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:59.718719 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-354a55a2-cd4d-4db0-9d7c-7ac1f7a0c908 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:59.719237 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-354a55a2-cd4d-4db0-9d7c-7ac1f7a0c908 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:59.719724 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-354a55a2-cd4d-4db0-9d7c-7ac1f7a0c908 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:59.720431 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-354a55a2-cd4d-4db0-9d7c-7ac1f7a0c908 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:59.720872 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-354a55a2-cd4d-4db0-9d7c-7ac1f7a0c908 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:59.721285 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-354a55a2-cd4d-4db0-9d7c-7ac1f7a0c908 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:59.787854 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-354a55a2-cd4d-4db0-9d7c-7ac1f7a0c908 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5594b2c1a2fd4bf8ad2f1c5d2c05b777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f83c7b81a54c9a936f140ca94e3d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:55:59.797543 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-354a55a2-cd4d-4db0-9d7c-7ac1f7a0c908 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] 10.222.0.25 "GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf" status: 200 len: 1274 microversion: 2.1 time: 0.090122 Sep 03 03:55:59.798240 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 442/892] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:55:59 2022] GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf => generated 1274 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:55:59.859525 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-a93e0517-1a61-45d8-892d-a199a56c3939 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0/os-volume_attachments/17df4cfe-a245-4bc3-a6e2-6aa710353d44" status: 200 len: 194 microversion: 2.1 time: 0.195714 Sep 03 03:55:59.860011 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 451/893] 10.222.0.25 () {58 vars in 1413 bytes} [Sat Sep 3 03:55:59 2022] GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0/os-volume_attachments/17df4cfe-a245-4bc3-a6e2-6aa710353d44 => generated 194 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:55:59.876336 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-6911ce4b-c304-4877-9d2f-11e559c4a173 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:55:59.876903 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-6911ce4b-c304-4877-9d2f-11e559c4a173 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 3d5f7818-14ce-4b6d-b040-6924c777d0d0] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:55:59.884891 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6911ce4b-c304-4877-9d2f-11e559c4a173 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:59.885373 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6911ce4b-c304-4877-9d2f-11e559c4a173 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:59.885806 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6911ce4b-c304-4877-9d2f-11e559c4a173 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:59.886492 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6911ce4b-c304-4877-9d2f-11e559c4a173 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:55:59.886971 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6911ce4b-c304-4877-9d2f-11e559c4a173 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:55:59.887397 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6911ce4b-c304-4877-9d2f-11e559c4a173 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:55:59.967605 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.objects.instance [None req-6911ce4b-c304-4877-9d2f-11e559c4a173 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lazy-loading 'services' on Instance uuid 3d5f7818-14ce-4b6d-b040-6924c777d0d0 {{(pid=132076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 03:56:00.005853 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-eec77984-afa1-45e0-af63-af607996d160 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:00.008033 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-eec77984-afa1-45e0-af63-af607996d160 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: d1d08b5f-9032-4848-ba25-122cd62f1432] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:00.014445 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eec77984-afa1-45e0-af63-af607996d160 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:00.014965 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eec77984-afa1-45e0-af63-af607996d160 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:00.015397 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eec77984-afa1-45e0-af63-af607996d160 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:00.016088 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eec77984-afa1-45e0-af63-af607996d160 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:00.016531 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eec77984-afa1-45e0-af63-af607996d160 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:00.016952 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-eec77984-afa1-45e0-af63-af607996d160 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:00.047696 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-eec77984-afa1-45e0-af63-af607996d160 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045766 Sep 03 03:56:00.048961 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 452/894] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Sep 3 03:56:00 2022] GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:56:00.055255 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-6911ce4b-c304-4877-9d2f-11e559c4a173 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0/os-volume_attachments/17df4cfe-a245-4bc3-a6e2-6aa710353d44" status: 202 len: 0 microversion: 2.1 time: 0.180393 Sep 03 03:56:00.055255 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 443/895] 10.222.0.25 () {58 vars in 1416 bytes} [Sat Sep 3 03:55:59 2022] DELETE /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0/os-volume_attachments/17df4cfe-a245-4bc3-a6e2-6aa710353d44 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 03:56:00.593811 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-bab62043-4a14-4192-bdbb-bc8119ebc905 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:00.594706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-bab62043-4a14-4192-bdbb-bc8119ebc905 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:00.603533 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bab62043-4a14-4192-bdbb-bc8119ebc905 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:00.604006 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bab62043-4a14-4192-bdbb-bc8119ebc905 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:00.604429 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bab62043-4a14-4192-bdbb-bc8119ebc905 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:00.605114 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bab62043-4a14-4192-bdbb-bc8119ebc905 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:00.605554 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bab62043-4a14-4192-bdbb-bc8119ebc905 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:00.606295 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-bab62043-4a14-4192-bdbb-bc8119ebc905 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:00.736411 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-bab62043-4a14-4192-bdbb-bc8119ebc905 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:00.744716 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-bab62043-4a14-4192-bdbb-bc8119ebc905 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:00.746166 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-bab62043-4a14-4192-bdbb-bc8119ebc905 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:00.747338 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-bab62043-4a14-4192-bdbb-bc8119ebc905 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1723 microversion: 2.20 time: 0.160228 Sep 03 03:56:00.747882 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 453/896] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:56:00 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:56:00.822669 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-8ce96d04-8f01-4f5d-b1b4-cc22f93b2baf tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:00.823396 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-8ce96d04-8f01-4f5d-b1b4-cc22f93b2baf tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] [instance: ed64ff03-ce00-49c3-868e-32a0be3fa6bf] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:00.829839 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8ce96d04-8f01-4f5d-b1b4-cc22f93b2baf tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:00.830325 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8ce96d04-8f01-4f5d-b1b4-cc22f93b2baf tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:00.830778 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8ce96d04-8f01-4f5d-b1b4-cc22f93b2baf tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:00.831497 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8ce96d04-8f01-4f5d-b1b4-cc22f93b2baf tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:00.831959 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8ce96d04-8f01-4f5d-b1b4-cc22f93b2baf tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:00.832378 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8ce96d04-8f01-4f5d-b1b4-cc22f93b2baf tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:00.936386 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-8ce96d04-8f01-4f5d-b1b4-cc22f93b2baf tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5594b2c1a2fd4bf8ad2f1c5d2c05b777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f83c7b81a54c9a936f140ca94e3d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:00.944220 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-8ce96d04-8f01-4f5d-b1b4-cc22f93b2baf tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] 10.222.0.25 "GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf" status: 200 len: 1274 microversion: 2.1 time: 0.126424 Sep 03 03:56:00.944801 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 444/897] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:56:00 2022] GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf => generated 1274 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:56:01.063189 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-fb1dc682-fe01-4a82-abae-d54920e0acd0 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:01.065617 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-fb1dc682-fe01-4a82-abae-d54920e0acd0 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: d1d08b5f-9032-4848-ba25-122cd62f1432] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:01.071592 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fb1dc682-fe01-4a82-abae-d54920e0acd0 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:01.072067 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fb1dc682-fe01-4a82-abae-d54920e0acd0 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:01.072488 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fb1dc682-fe01-4a82-abae-d54920e0acd0 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:01.073203 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fb1dc682-fe01-4a82-abae-d54920e0acd0 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:01.073671 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fb1dc682-fe01-4a82-abae-d54920e0acd0 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:01.074082 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fb1dc682-fe01-4a82-abae-d54920e0acd0 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:01.108246 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-fb1dc682-fe01-4a82-abae-d54920e0acd0 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048757 Sep 03 03:56:01.109485 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 454/898] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Sep 3 03:56:01 2022] GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:56:01.775505 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-9075afb6-cc69-4b82-b064-3bcabc646eb4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:01.776183 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-9075afb6-cc69-4b82-b064-3bcabc646eb4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:01.779346 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell0:SELECT=2 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:56:01.780562 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell0:SELECT=6 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:56:01.786196 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9075afb6-cc69-4b82-b064-3bcabc646eb4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:01.786698 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9075afb6-cc69-4b82-b064-3bcabc646eb4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:01.787207 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9075afb6-cc69-4b82-b064-3bcabc646eb4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:01.788142 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9075afb6-cc69-4b82-b064-3bcabc646eb4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:01.788587 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9075afb6-cc69-4b82-b064-3bcabc646eb4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:01.789018 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9075afb6-cc69-4b82-b064-3bcabc646eb4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:01.967250 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-ab8d1935-6748-456d-9043-e7642da1db31 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:01.967852 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-ab8d1935-6748-456d-9043-e7642da1db31 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] [instance: ed64ff03-ce00-49c3-868e-32a0be3fa6bf] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:01.971454 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell0:SELECT=2 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:56:01.975344 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ab8d1935-6748-456d-9043-e7642da1db31 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:01.975841 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ab8d1935-6748-456d-9043-e7642da1db31 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:01.976266 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ab8d1935-6748-456d-9043-e7642da1db31 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:01.976988 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ab8d1935-6748-456d-9043-e7642da1db31 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:01.977430 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ab8d1935-6748-456d-9043-e7642da1db31 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:01.977848 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ab8d1935-6748-456d-9043-e7642da1db31 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:02.045448 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-ab8d1935-6748-456d-9043-e7642da1db31 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5594b2c1a2fd4bf8ad2f1c5d2c05b777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f83c7b81a54c9a936f140ca94e3d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:02.054006 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-ab8d1935-6748-456d-9043-e7642da1db31 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] 10.222.0.25 "GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf" status: 200 len: 1272 microversion: 2.1 time: 0.090617 Sep 03 03:56:02.054972 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 455/899] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:56:01 2022] GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf => generated 1272 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:56:02.093693 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-9075afb6-cc69-4b82-b064-3bcabc646eb4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:02.105925 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-9075afb6-cc69-4b82-b064-3bcabc646eb4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:02.107598 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-9075afb6-cc69-4b82-b064-3bcabc646eb4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:02.108789 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-9075afb6-cc69-4b82-b064-3bcabc646eb4 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1723 microversion: 2.20 time: 0.340064 Sep 03 03:56:02.112650 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 445/900] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:56:01 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1723 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:56:02.127564 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-efcb539f-17d4-4371-a10a-fce03e9d86d1 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:02.130047 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-efcb539f-17d4-4371-a10a-fce03e9d86d1 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: d1d08b5f-9032-4848-ba25-122cd62f1432] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:02.136711 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-efcb539f-17d4-4371-a10a-fce03e9d86d1 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:02.137182 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-efcb539f-17d4-4371-a10a-fce03e9d86d1 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:02.137637 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-efcb539f-17d4-4371-a10a-fce03e9d86d1 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:02.138351 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-efcb539f-17d4-4371-a10a-fce03e9d86d1 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:02.138843 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-efcb539f-17d4-4371-a10a-fce03e9d86d1 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:02.139256 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-efcb539f-17d4-4371-a10a-fce03e9d86d1 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:02.168608 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-efcb539f-17d4-4371-a10a-fce03e9d86d1 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045081 Sep 03 03:56:02.169173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 456/901] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Sep 3 03:56:02 2022] GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 03:56:02.233115 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-3fb2728f-94d1-4bc9-ab6a-ae416b3a4019 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:02.233855 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-3fb2728f-94d1-4bc9-ab6a-ae416b3a4019 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: d1d08b5f-9032-4848-ba25-122cd62f1432] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:02.239864 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3fb2728f-94d1-4bc9-ab6a-ae416b3a4019 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:02.240576 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3fb2728f-94d1-4bc9-ab6a-ae416b3a4019 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:02.241251 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3fb2728f-94d1-4bc9-ab6a-ae416b3a4019 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:02.242124 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3fb2728f-94d1-4bc9-ab6a-ae416b3a4019 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:02.244442 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3fb2728f-94d1-4bc9-ab6a-ae416b3a4019 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:02.245062 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3fb2728f-94d1-4bc9-ab6a-ae416b3a4019 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:02.330721 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-412fb711-d667-4b3f-8e7b-f7bb5987669a tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:02.333154 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-412fb711-d667-4b3f-8e7b-f7bb5987669a tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 3d5f7818-14ce-4b6d-b040-6924c777d0d0] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:02.340287 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-412fb711-d667-4b3f-8e7b-f7bb5987669a tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:02.340967 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-412fb711-d667-4b3f-8e7b-f7bb5987669a tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:02.341558 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-412fb711-d667-4b3f-8e7b-f7bb5987669a tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:02.342421 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-412fb711-d667-4b3f-8e7b-f7bb5987669a tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:02.343084 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-412fb711-d667-4b3f-8e7b-f7bb5987669a tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:02.343678 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-412fb711-d667-4b3f-8e7b-f7bb5987669a tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:02.393412 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-412fb711-d667-4b3f-8e7b-f7bb5987669a tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066521 Sep 03 03:56:02.394442 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 457/902] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Sep 3 03:56:02 2022] GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 03 03:56:02.490313 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-3fb2728f-94d1-4bc9-ab6a-ae416b3a4019 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: d1d08b5f-9032-4848-ba25-122cd62f1432] Going to try to terminate instance {{(pid=132076) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 03:56:02.550423 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-5d567e9d-fd8f-43dc-ab1a-d7dd1da4380d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:02.553378 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-5d567e9d-fd8f-43dc-ab1a-d7dd1da4380d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 3d5f7818-14ce-4b6d-b040-6924c777d0d0] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:02.560990 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5d567e9d-fd8f-43dc-ab1a-d7dd1da4380d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:02.561724 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5d567e9d-fd8f-43dc-ab1a-d7dd1da4380d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:02.562359 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5d567e9d-fd8f-43dc-ab1a-d7dd1da4380d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:02.564009 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5d567e9d-fd8f-43dc-ab1a-d7dd1da4380d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:02.564755 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5d567e9d-fd8f-43dc-ab1a-d7dd1da4380d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:02.565387 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5d567e9d-fd8f-43dc-ab1a-d7dd1da4380d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:02.608988 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-3fb2728f-94d1-4bc9-ab6a-ae416b3a4019 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432" status: 204 len: 0 microversion: 2.1 time: 0.379735 Sep 03 03:56:02.610478 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 446/903] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Sep 3 03:56:02 2022] DELETE /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 03:56:02.623397 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-99ceddb4-4b27-4f51-9ea4-85467d1938b6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:02.628582 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-99ceddb4-4b27-4f51-9ea4-85467d1938b6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: d1d08b5f-9032-4848-ba25-122cd62f1432] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:02.637575 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-5d567e9d-fd8f-43dc-ab1a-d7dd1da4380d tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.091340 Sep 03 03:56:02.639046 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-99ceddb4-4b27-4f51-9ea4-85467d1938b6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:02.639932 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-99ceddb4-4b27-4f51-9ea4-85467d1938b6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:02.640686 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-99ceddb4-4b27-4f51-9ea4-85467d1938b6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:02.641561 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-99ceddb4-4b27-4f51-9ea4-85467d1938b6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:02.642221 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-99ceddb4-4b27-4f51-9ea4-85467d1938b6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:02.643076 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-99ceddb4-4b27-4f51-9ea4-85467d1938b6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:02.644292 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 458/904] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Sep 3 03:56:02 2022] GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0/os-volume_attachments => generated 25 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 03 03:56:02.658769 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-1412ecc7-eba0-4685-a736-1c3c2273a008 req-60de2358-a758-4e9d-9293-943126406ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc53cf40-e9bf-4403-92b0-7bae49adae43", "name": "network-vif-deleted", "tag": "1f618203-8c7d-4d80-8d91-954bafd0d268"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:56:02.684409 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-1412ecc7-eba0-4685-a736-1c3c2273a008 req-60de2358-a758-4e9d-9293-943126406ea9 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:02.684905 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-1412ecc7-eba0-4685-a736-1c3c2273a008 req-60de2358-a758-4e9d-9293-943126406ea9 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:02.685338 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-1412ecc7-eba0-4685-a736-1c3c2273a008 req-60de2358-a758-4e9d-9293-943126406ea9 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:02.724524 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-1412ecc7-eba0-4685-a736-1c3c2273a008 req-60de2358-a758-4e9d-9293-943126406ea9 service nova] Creating event network-vif-deleted:1f618203-8c7d-4d80-8d91-954bafd0d268 for instance cc53cf40-e9bf-4403-92b0-7bae49adae43 on hv-cinder-79966 Sep 03 03:56:02.730288 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-1412ecc7-eba0-4685-a736-1c3c2273a008 req-60de2358-a758-4e9d-9293-943126406ea9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076641 Sep 03 03:56:02.731785 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 459/905] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 03:56:02.737915 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-b16b2331-7aaa-4fec-b149-03826329bb42 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:02.738381 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-b16b2331-7aaa-4fec-b149-03826329bb42 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 3d5f7818-14ce-4b6d-b040-6924c777d0d0] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:02.746336 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b16b2331-7aaa-4fec-b149-03826329bb42 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:02.747861 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b16b2331-7aaa-4fec-b149-03826329bb42 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:02.747861 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b16b2331-7aaa-4fec-b149-03826329bb42 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:02.748090 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b16b2331-7aaa-4fec-b149-03826329bb42 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:02.748695 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b16b2331-7aaa-4fec-b149-03826329bb42 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:02.749119 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b16b2331-7aaa-4fec-b149-03826329bb42 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:02.779480 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-b16b2331-7aaa-4fec-b149-03826329bb42 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 3d5f7818-14ce-4b6d-b040-6924c777d0d0] Going to try to terminate instance {{(pid=132077) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 03:56:02.809701 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:56:02.872729 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-b16b2331-7aaa-4fec-b149-03826329bb42 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0" status: 204 len: 0 microversion: 2.1 time: 0.139277 Sep 03 03:56:02.873586 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 460/906] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Sep 3 03:56:02 2022] DELETE /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 03:56:02.883784 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-d5151fb6-327a-46ed-8b1e-42c63671d5fa tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:02.884475 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-d5151fb6-327a-46ed-8b1e-42c63671d5fa tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 3d5f7818-14ce-4b6d-b040-6924c777d0d0] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:02.891049 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d5151fb6-327a-46ed-8b1e-42c63671d5fa tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:02.891429 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d5151fb6-327a-46ed-8b1e-42c63671d5fa tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:02.892011 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d5151fb6-327a-46ed-8b1e-42c63671d5fa tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:02.893017 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d5151fb6-327a-46ed-8b1e-42c63671d5fa tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:02.893670 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d5151fb6-327a-46ed-8b1e-42c63671d5fa tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:02.894328 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d5151fb6-327a-46ed-8b1e-42c63671d5fa tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:02.948396 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-99ceddb4-4b27-4f51-9ea4-85467d1938b6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:02.956836 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-99ceddb4-4b27-4f51-9ea4-85467d1938b6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432" status: 200 len: 1679 microversion: 2.1 time: 0.337689 Sep 03 03:56:02.957920 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 447/907] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:56:02 2022] GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432 => generated 1679 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:56:03.049247 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-d5151fb6-327a-46ed-8b1e-42c63671d5fa tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:03.057567 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-d5151fb6-327a-46ed-8b1e-42c63671d5fa tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0" status: 200 len: 1673 microversion: 2.1 time: 0.179782 Sep 03 03:56:03.058443 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 461/908] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:56:02 2022] GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0 => generated 1673 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:56:03.079274 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-4ab3b9ec-1990-4dc6-9d1a-4801acf3b3e5 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:03.079869 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-4ab3b9ec-1990-4dc6-9d1a-4801acf3b3e5 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] [instance: ed64ff03-ce00-49c3-868e-32a0be3fa6bf] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:03.086186 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4ab3b9ec-1990-4dc6-9d1a-4801acf3b3e5 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:03.086784 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4ab3b9ec-1990-4dc6-9d1a-4801acf3b3e5 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:03.087384 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4ab3b9ec-1990-4dc6-9d1a-4801acf3b3e5 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:03.088146 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4ab3b9ec-1990-4dc6-9d1a-4801acf3b3e5 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:03.090858 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4ab3b9ec-1990-4dc6-9d1a-4801acf3b3e5 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:03.091622 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4ab3b9ec-1990-4dc6-9d1a-4801acf3b3e5 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:03.139775 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-a3abb4df-e687-4b43-8f36-e4546d3c7566 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:03.140446 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-a3abb4df-e687-4b43-8f36-e4546d3c7566 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:03.147615 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a3abb4df-e687-4b43-8f36-e4546d3c7566 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:03.148167 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a3abb4df-e687-4b43-8f36-e4546d3c7566 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:03.148665 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a3abb4df-e687-4b43-8f36-e4546d3c7566 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:03.149448 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a3abb4df-e687-4b43-8f36-e4546d3c7566 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:03.149964 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a3abb4df-e687-4b43-8f36-e4546d3c7566 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:03.150454 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a3abb4df-e687-4b43-8f36-e4546d3c7566 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:03.227168 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a3abb4df-e687-4b43-8f36-e4546d3c7566 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:03.239427 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a3abb4df-e687-4b43-8f36-e4546d3c7566 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:03.241100 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a3abb4df-e687-4b43-8f36-e4546d3c7566 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:03.242502 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-a3abb4df-e687-4b43-8f36-e4546d3c7566 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1656 microversion: 2.20 time: 0.106807 Sep 03 03:56:03.243094 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 462/909] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:56:03 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1656 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 03:56:03.307529 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-4ab3b9ec-1990-4dc6-9d1a-4801acf3b3e5 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5594b2c1a2fd4bf8ad2f1c5d2c05b777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f83c7b81a54c9a936f140ca94e3d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:03.315447 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-4ab3b9ec-1990-4dc6-9d1a-4801acf3b3e5 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] 10.222.0.25 "GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf" status: 200 len: 1314 microversion: 2.1 time: 0.239922 Sep 03 03:56:03.316594 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 448/910] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:56:03 2022] GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:56:03.979980 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-2bfc1050-ff4f-42d3-8f56-731d4142fb34 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:03.980578 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-2bfc1050-ff4f-42d3-8f56-731d4142fb34 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: d1d08b5f-9032-4848-ba25-122cd62f1432] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:03.987892 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2bfc1050-ff4f-42d3-8f56-731d4142fb34 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:03.988340 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2bfc1050-ff4f-42d3-8f56-731d4142fb34 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:03.988765 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2bfc1050-ff4f-42d3-8f56-731d4142fb34 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:03.989448 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2bfc1050-ff4f-42d3-8f56-731d4142fb34 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:03.989894 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2bfc1050-ff4f-42d3-8f56-731d4142fb34 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:03.990309 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-2bfc1050-ff4f-42d3-8f56-731d4142fb34 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:04.081682 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-77320120-6705-4467-ace3-f78d447ccfec tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:04.082477 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-77320120-6705-4467-ace3-f78d447ccfec tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 3d5f7818-14ce-4b6d-b040-6924c777d0d0] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:04.091913 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-77320120-6705-4467-ace3-f78d447ccfec tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:04.092439 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-77320120-6705-4467-ace3-f78d447ccfec tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:04.092964 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-77320120-6705-4467-ace3-f78d447ccfec tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:04.093991 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-77320120-6705-4467-ace3-f78d447ccfec tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:04.094591 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-77320120-6705-4467-ace3-f78d447ccfec tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:04.095247 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-77320120-6705-4467-ace3-f78d447ccfec tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:04.101330 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:56:04.137293 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-2bfc1050-ff4f-42d3-8f56-731d4142fb34 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:04.145443 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-2bfc1050-ff4f-42d3-8f56-731d4142fb34 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432" status: 200 len: 1679 microversion: 2.1 time: 0.169340 Sep 03 03:56:04.146022 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 463/911] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:56:03 2022] GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:56:04.232144 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-77320120-6705-4467-ace3-f78d447ccfec tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:04.241189 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-77320120-6705-4467-ace3-f78d447ccfec tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0" status: 200 len: 1673 microversion: 2.1 time: 0.162985 Sep 03 03:56:04.241885 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 449/912] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:56:04 2022] GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:56:04.273828 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-b4af4c02-fcda-4a1b-9655-86f516805602 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:04.274486 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-b4af4c02-fcda-4a1b-9655-86f516805602 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:04.282787 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b4af4c02-fcda-4a1b-9655-86f516805602 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:04.283303 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b4af4c02-fcda-4a1b-9655-86f516805602 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:04.283928 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b4af4c02-fcda-4a1b-9655-86f516805602 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:04.285000 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b4af4c02-fcda-4a1b-9655-86f516805602 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:04.285645 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b4af4c02-fcda-4a1b-9655-86f516805602 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:04.286321 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b4af4c02-fcda-4a1b-9655-86f516805602 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:04.339215 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-511eceb2-28bf-4679-b99f-4d83024a634d tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:04.339824 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-511eceb2-28bf-4679-b99f-4d83024a634d tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] [instance: ed64ff03-ce00-49c3-868e-32a0be3fa6bf] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:04.346055 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-511eceb2-28bf-4679-b99f-4d83024a634d tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:04.346537 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-511eceb2-28bf-4679-b99f-4d83024a634d tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:04.347003 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-511eceb2-28bf-4679-b99f-4d83024a634d tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:04.347686 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-511eceb2-28bf-4679-b99f-4d83024a634d tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:04.348132 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-511eceb2-28bf-4679-b99f-4d83024a634d tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:04.348562 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-511eceb2-28bf-4679-b99f-4d83024a634d tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:04.353463 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-b4af4c02-fcda-4a1b-9655-86f516805602 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:04.362372 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-b4af4c02-fcda-4a1b-9655-86f516805602 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:04.363852 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-b4af4c02-fcda-4a1b-9655-86f516805602 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:04.364983 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-b4af4c02-fcda-4a1b-9655-86f516805602 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1366 microversion: 2.20 time: 0.095248 Sep 03 03:56:04.365529 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 464/913] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:56:04 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1366 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 03:56:04.480935 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-511eceb2-28bf-4679-b99f-4d83024a634d tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5594b2c1a2fd4bf8ad2f1c5d2c05b777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f83c7b81a54c9a936f140ca94e3d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:04.490049 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-511eceb2-28bf-4679-b99f-4d83024a634d tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] 10.222.0.25 "GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf" status: 200 len: 1314 microversion: 2.1 time: 0.154580 Sep 03 03:56:04.491096 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 450/914] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:56:04 2022] GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:56:04.775384 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-97635dc6-c38e-4262-ad5e-a4212f473ce5 req-2be84be9-41fe-4032-9ef3-ddc258fd81c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed64ff03-ce00-49c3-868e-32a0be3fa6bf", "tag": "82c62b2e-5cba-4fe3-a25f-2938d6b39233"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:56:04.789728 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-97635dc6-c38e-4262-ad5e-a4212f473ce5 req-2be84be9-41fe-4032-9ef3-ddc258fd81c5 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:04.790197 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-97635dc6-c38e-4262-ad5e-a4212f473ce5 req-2be84be9-41fe-4032-9ef3-ddc258fd81c5 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:04.790636 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-97635dc6-c38e-4262-ad5e-a4212f473ce5 req-2be84be9-41fe-4032-9ef3-ddc258fd81c5 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:04.802557 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-97635dc6-c38e-4262-ad5e-a4212f473ce5 req-2be84be9-41fe-4032-9ef3-ddc258fd81c5 service nova] Creating event network-changed:82c62b2e-5cba-4fe3-a25f-2938d6b39233 for instance ed64ff03-ce00-49c3-868e-32a0be3fa6bf on hv-cinder-79966 Sep 03 03:56:04.807498 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-97635dc6-c38e-4262-ad5e-a4212f473ce5 req-2be84be9-41fe-4032-9ef3-ddc258fd81c5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038289 Sep 03 03:56:04.808072 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 465/915] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:56:05.172653 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-8b3259c7-f8c5-472e-bdde-be11ef73ca9d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:05.173531 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-8b3259c7-f8c5-472e-bdde-be11ef73ca9d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: d1d08b5f-9032-4848-ba25-122cd62f1432] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:05.181916 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8b3259c7-f8c5-472e-bdde-be11ef73ca9d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:05.182393 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8b3259c7-f8c5-472e-bdde-be11ef73ca9d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:05.182832 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8b3259c7-f8c5-472e-bdde-be11ef73ca9d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:05.183529 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8b3259c7-f8c5-472e-bdde-be11ef73ca9d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:05.184003 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8b3259c7-f8c5-472e-bdde-be11ef73ca9d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:05.184432 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8b3259c7-f8c5-472e-bdde-be11ef73ca9d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:05.269151 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-fcb2c99b-bbc4-49af-80aa-1f7c7895ef89 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:05.269873 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-fcb2c99b-bbc4-49af-80aa-1f7c7895ef89 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 3d5f7818-14ce-4b6d-b040-6924c777d0d0] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:05.276475 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fcb2c99b-bbc4-49af-80aa-1f7c7895ef89 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:05.276965 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fcb2c99b-bbc4-49af-80aa-1f7c7895ef89 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:05.277399 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fcb2c99b-bbc4-49af-80aa-1f7c7895ef89 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:05.278101 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fcb2c99b-bbc4-49af-80aa-1f7c7895ef89 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:05.278583 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fcb2c99b-bbc4-49af-80aa-1f7c7895ef89 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:05.279036 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fcb2c99b-bbc4-49af-80aa-1f7c7895ef89 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:05.324128 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-8b3259c7-f8c5-472e-bdde-be11ef73ca9d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:05.332257 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-8b3259c7-f8c5-472e-bdde-be11ef73ca9d tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432" status: 200 len: 1679 microversion: 2.1 time: 0.166123 Sep 03 03:56:05.332908 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 451/916] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:56:05 2022] GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:56:05.389581 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-e9e60412-1bb7-49db-bbed-c66e98948314 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:05.390312 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-e9e60412-1bb7-49db-bbed-c66e98948314 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:05.396343 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e9e60412-1bb7-49db-bbed-c66e98948314 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:05.396821 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e9e60412-1bb7-49db-bbed-c66e98948314 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:05.397320 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e9e60412-1bb7-49db-bbed-c66e98948314 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:05.398001 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e9e60412-1bb7-49db-bbed-c66e98948314 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:05.398443 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e9e60412-1bb7-49db-bbed-c66e98948314 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:05.398857 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-e9e60412-1bb7-49db-bbed-c66e98948314 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:05.410092 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-fcb2c99b-bbc4-49af-80aa-1f7c7895ef89 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:05.417770 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-fcb2c99b-bbc4-49af-80aa-1f7c7895ef89 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0" status: 200 len: 1673 microversion: 2.1 time: 0.153255 Sep 03 03:56:05.418357 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 466/917] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:56:05 2022] GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:56:05.459569 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-e9e60412-1bb7-49db-bbed-c66e98948314 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:05.467631 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-e9e60412-1bb7-49db-bbed-c66e98948314 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:05.469040 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-e9e60412-1bb7-49db-bbed-c66e98948314 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31a8c62bd81f4c1f863bd952b6976276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d80eadc5cc34322b85201c50b3c6552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:05.470154 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-e9e60412-1bb7-49db-bbed-c66e98948314 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 200 len: 1366 microversion: 2.20 time: 0.084437 Sep 03 03:56:05.470662 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 452/918] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:56:05 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 03:56:05.517317 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-b2bbe84b-3af8-431b-9251-a9c1d3ac8d96 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:05.518292 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-b2bbe84b-3af8-431b-9251-a9c1d3ac8d96 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] [instance: ed64ff03-ce00-49c3-868e-32a0be3fa6bf] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:05.528146 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b2bbe84b-3af8-431b-9251-a9c1d3ac8d96 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:05.528932 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b2bbe84b-3af8-431b-9251-a9c1d3ac8d96 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:05.529647 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b2bbe84b-3af8-431b-9251-a9c1d3ac8d96 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:05.530776 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b2bbe84b-3af8-431b-9251-a9c1d3ac8d96 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:05.531565 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b2bbe84b-3af8-431b-9251-a9c1d3ac8d96 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:05.532257 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b2bbe84b-3af8-431b-9251-a9c1d3ac8d96 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:05.670378 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-b2bbe84b-3af8-431b-9251-a9c1d3ac8d96 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5594b2c1a2fd4bf8ad2f1c5d2c05b777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f83c7b81a54c9a936f140ca94e3d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:05.678818 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-b2bbe84b-3af8-431b-9251-a9c1d3ac8d96 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] 10.222.0.25 "GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf" status: 200 len: 1314 microversion: 2.1 time: 0.167809 Sep 03 03:56:05.679669 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 467/919] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:56:05 2022] GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:56:06.356069 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-158f1d67-694b-4fba-b796-c83199ba7974 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:06.356670 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-158f1d67-694b-4fba-b796-c83199ba7974 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: d1d08b5f-9032-4848-ba25-122cd62f1432] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:06.364164 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-158f1d67-694b-4fba-b796-c83199ba7974 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:06.364646 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-158f1d67-694b-4fba-b796-c83199ba7974 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:06.365072 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-158f1d67-694b-4fba-b796-c83199ba7974 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:06.365769 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-158f1d67-694b-4fba-b796-c83199ba7974 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:06.366203 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-158f1d67-694b-4fba-b796-c83199ba7974 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:06.366614 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-158f1d67-694b-4fba-b796-c83199ba7974 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:06.442166 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-cebdbe84-0033-4958-ab8d-67f5ec85a01c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:06.442867 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-cebdbe84-0033-4958-ab8d-67f5ec85a01c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 3d5f7818-14ce-4b6d-b040-6924c777d0d0] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:06.455825 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cebdbe84-0033-4958-ab8d-67f5ec85a01c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:06.455825 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cebdbe84-0033-4958-ab8d-67f5ec85a01c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:06.456253 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cebdbe84-0033-4958-ab8d-67f5ec85a01c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:06.456971 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cebdbe84-0033-4958-ab8d-67f5ec85a01c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:06.457419 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cebdbe84-0033-4958-ab8d-67f5ec85a01c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:06.457843 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cebdbe84-0033-4958-ab8d-67f5ec85a01c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:06.544482 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-cebdbe84-0033-4958-ab8d-67f5ec85a01c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:06.552805 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-cebdbe84-0033-4958-ab8d-67f5ec85a01c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0" status: 200 len: 1605 microversion: 2.1 time: 0.114611 Sep 03 03:56:06.553569 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 468/920] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:56:06 2022] GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0 => generated 1605 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:56:06.559920 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-cc033add-5b77-4822-a94d-297ef413b966 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:06.560665 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-cc033add-5b77-4822-a94d-297ef413b966 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:06.567694 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cc033add-5b77-4822-a94d-297ef413b966 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:06.568273 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cc033add-5b77-4822-a94d-297ef413b966 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:06.569190 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cc033add-5b77-4822-a94d-297ef413b966 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:06.571349 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cc033add-5b77-4822-a94d-297ef413b966 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:06.571939 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cc033add-5b77-4822-a94d-297ef413b966 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:06.572387 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cc033add-5b77-4822-a94d-297ef413b966 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:06.584652 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-158f1d67-694b-4fba-b796-c83199ba7974 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:06.593848 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-158f1d67-694b-4fba-b796-c83199ba7974 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432" status: 200 len: 1679 microversion: 2.1 time: 0.241953 Sep 03 03:56:06.601343 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.wsgi [None req-cc033add-5b77-4822-a94d-297ef413b966 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] HTTP exception thrown: Instance cc53cf40-e9bf-4403-92b0-7bae49adae43 could not be found. Sep 03 03:56:06.603470 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-cc033add-5b77-4822-a94d-297ef413b966 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Request method failure captured: Sep 03 03:56:06.603470 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: request: GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 HTTP/1.1 Sep 03 03:56:06.603470 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept: application/json Sep 03 03:56:06.603470 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept-Encoding: identity Sep 03 03:56:06.603470 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Connection: close Sep 03 03:56:06.603470 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Length: 0 Sep 03 03:56:06.603470 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Type: application/json Sep 03 03:56:06.603470 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Host: 10.222.0.25 Sep 03 03:56:06.603470 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Openstack-System-Scope: None Sep 03 03:56:06.603470 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: User-Agent: python-urllib3/1.26.12 Sep 03 03:56:06.603470 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Auth-Token: gAAAAABjEs69BRGC6P6wBJAUTmtITvT_vIw0gPds8bq0Ck7UAz1bo7CB8mFb-VFBiBFm8hZHRYtPTy2K0wjbLuKWVIEOTzAutTGmbrr-bFM_gcnv-f2-BjsF6yImlUNPqD-nULDssJKi4jaJ6RtDHDHo4FVzgRyBXvdxlqqtKqS0j7ZF8HSGrRo Sep 03 03:56:06.603470 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Id: None Sep 03 03:56:06.603470 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Name: None Sep 03 03:56:06.603470 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Identity-Status: Confirmed Sep 03 03:56:06.603470 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Is-Admin-Project: True Sep 03 03:56:06.603470 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Openstack-Nova-Api-Version: 2.20 Sep 03 03:56:06.603470 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Id: default Sep 03 03:56:06.603470 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Name: Default Sep 03 03:56:06.603470 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Id: 4d80eadc5cc34322b85201c50b3c6552 Sep 03 03:56:06.603470 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1191556674 Sep 03 03:56:06.603470 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Role: member,reader Sep 03 03:56:06.603470 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Roles: member,reader Sep 03 03:56:06.605273 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d80eadc5cc34322b85201c50b3c6552"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4d80eadc5cc34322b85201c50b3c6552"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4d80eadc5cc34322b85201c50b3c6552"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d80eadc5cc34322b85201c50b3c6552"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:56:06.605273 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1191556674 Sep 03 03:56:06.605273 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Id: 4d80eadc5cc34322b85201c50b3c6552 Sep 03 03:56:06.605273 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1191556674 Sep 03 03:56:06.605273 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User: tempest-AttachVolumeShelveTestJSON-1191556674-project Sep 03 03:56:06.605273 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Id: default Sep 03 03:56:06.605273 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Name: Default Sep 03 03:56:06.605273 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Id: 31a8c62bd81f4c1f863bd952b6976276 Sep 03 03:56:06.605273 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1191556674-project Sep 03 03:56:06.605273 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: method: > Sep 03 03:56:06.605273 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: exception: Instance cc53cf40-e9bf-4403-92b0-7bae49adae43 could not be found. Sep 03 03:56:06.605273 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: action_args: {'id': 'cc53cf40-e9bf-4403-92b0-7bae49adae43'} Sep 03 03:56:06.606566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:56:06.606566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:06.606566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 03:56:06.606566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 03:56:06.606566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 03:56:06.606566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 03:56:06.606566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 03:56:06.606566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 03:56:06.606566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 03:56:06.606566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 03:56:06.606566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc53cf40-e9bf-4403-92b0-7bae49adae43 could not be found. Sep 03 03:56:06.606566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:06.606566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:06.606566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:06.606566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:06.606566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:06.606566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:06.606566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:56:06.606566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:56:06.606566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:56:06.608173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:56:06.608173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 03:56:06.608173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 03:56:06.608173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 03:56:06.608173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 03:56:06.608173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 03:56:06.608173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:56:06.608173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc53cf40-e9bf-4403-92b0-7bae49adae43 could not be found. Sep 03 03:56:06.608173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:06.608173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:06.608173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:06.608173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:06.608173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:06.608173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:06.608173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:56:06.608173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:56:06.608173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc53cf40-e9bf-4403-92b0-7bae49adae43 could not be found. Sep 03 03:56:06.608173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:06.609829 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 453/921] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:56:06 2022] GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432 => generated 1679 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:56:06.611118 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-cc033add-5b77-4822-a94d-297ef413b966 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Returning 404 to user: Instance cc53cf40-e9bf-4403-92b0-7bae49adae43 could not be found. {{(pid=132077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:56:06.612178 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-cc033add-5b77-4822-a94d-297ef413b966 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 404 len: 111 microversion: 2.20 time: 0.057161 Sep 03 03:56:06.616293 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 469/922] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:56:06 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 03 03:56:06.621838 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-19f75bf4-9867-4b70-9223-55bd0689baa3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '.version_select at 0x7f45fc5559d0>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:06.640679 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-19f75bf4-9867-4b70-9223-55bd0689baa3 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1463254690" status: 204 len: 0 microversion: 2.20 time: 0.023042 Sep 03 03:56:06.641232 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 454/923] 10.222.0.25 () {60 vars in 1262 bytes} [Sat Sep 3 03:56:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1463254690 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 03 03:56:06.703610 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-8afb54e4-ad7b-42a7-9a13-f22105088489 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:06.704240 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-8afb54e4-ad7b-42a7-9a13-f22105088489 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] [instance: ed64ff03-ce00-49c3-868e-32a0be3fa6bf] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:06.726682 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8afb54e4-ad7b-42a7-9a13-f22105088489 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:06.727475 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8afb54e4-ad7b-42a7-9a13-f22105088489 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:06.728274 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8afb54e4-ad7b-42a7-9a13-f22105088489 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:06.729722 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8afb54e4-ad7b-42a7-9a13-f22105088489 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:06.730332 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8afb54e4-ad7b-42a7-9a13-f22105088489 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:06.731272 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8afb54e4-ad7b-42a7-9a13-f22105088489 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:06.919545 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-8afb54e4-ad7b-42a7-9a13-f22105088489 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5594b2c1a2fd4bf8ad2f1c5d2c05b777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f83c7b81a54c9a936f140ca94e3d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:06.937279 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-8afb54e4-ad7b-42a7-9a13-f22105088489 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] 10.222.0.25 "GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf" status: 200 len: 1314 microversion: 2.1 time: 0.238919 Sep 03 03:56:06.938248 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 470/924] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:56:06 2022] GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:56:06.955041 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-6ea7f2af-040d-44fc-940c-5dd0a9f65fed req-7cde1a71-acd7-41b8-bca3-4fb2582573d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d5f7818-14ce-4b6d-b040-6924c777d0d0", "name": "network-vif-deleted", "tag": "8bd4fb48-65f5-4f59-8039-923cd37f3c8d"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:56:06.966475 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-6ea7f2af-040d-44fc-940c-5dd0a9f65fed req-7cde1a71-acd7-41b8-bca3-4fb2582573d9 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:06.966999 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-6ea7f2af-040d-44fc-940c-5dd0a9f65fed req-7cde1a71-acd7-41b8-bca3-4fb2582573d9 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:06.967427 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-6ea7f2af-040d-44fc-940c-5dd0a9f65fed req-7cde1a71-acd7-41b8-bca3-4fb2582573d9 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:06.985846 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-6ea7f2af-040d-44fc-940c-5dd0a9f65fed req-7cde1a71-acd7-41b8-bca3-4fb2582573d9 service nova] Creating event network-vif-deleted:8bd4fb48-65f5-4f59-8039-923cd37f3c8d for instance 3d5f7818-14ce-4b6d-b040-6924c777d0d0 on hv-cinder-79966 Sep 03 03:56:06.991580 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-6ea7f2af-040d-44fc-940c-5dd0a9f65fed req-7cde1a71-acd7-41b8-bca3-4fb2582573d9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.213007 Sep 03 03:56:06.992579 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 455/925] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:56:07.529910 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-b79ee222-88f2-41c0-84a2-0ca05f8256a5 req-a356e2bf-43f0-4a26-9b89-9125fa9368f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1d08b5f-9032-4848-ba25-122cd62f1432", "name": "network-vif-deleted", "tag": "4369d0d8-6566-4456-8e12-b1fef3c45df0"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:56:07.544647 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-b79ee222-88f2-41c0-84a2-0ca05f8256a5 req-a356e2bf-43f0-4a26-9b89-9125fa9368f4 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:07.545270 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-b79ee222-88f2-41c0-84a2-0ca05f8256a5 req-a356e2bf-43f0-4a26-9b89-9125fa9368f4 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:07.547082 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-b79ee222-88f2-41c0-84a2-0ca05f8256a5 req-a356e2bf-43f0-4a26-9b89-9125fa9368f4 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:07.569888 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-b79ee222-88f2-41c0-84a2-0ca05f8256a5 req-a356e2bf-43f0-4a26-9b89-9125fa9368f4 service nova] Creating event network-vif-deleted:4369d0d8-6566-4456-8e12-b1fef3c45df0 for instance d1d08b5f-9032-4848-ba25-122cd62f1432 on hv-cinder-79966 Sep 03 03:56:07.581286 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-4769a6f7-04c3-453d-8bac-59db7d7d457c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:07.582094 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-4769a6f7-04c3-453d-8bac-59db7d7d457c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 3d5f7818-14ce-4b6d-b040-6924c777d0d0] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:07.592326 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4769a6f7-04c3-453d-8bac-59db7d7d457c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:07.592980 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4769a6f7-04c3-453d-8bac-59db7d7d457c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:07.594744 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-b79ee222-88f2-41c0-84a2-0ca05f8256a5 req-a356e2bf-43f0-4a26-9b89-9125fa9368f4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068882 Sep 03 03:56:07.595690 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 471/926] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:56:07.599631 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4769a6f7-04c3-453d-8bac-59db7d7d457c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:07.600389 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4769a6f7-04c3-453d-8bac-59db7d7d457c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:07.600858 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4769a6f7-04c3-453d-8bac-59db7d7d457c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:07.601284 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4769a6f7-04c3-453d-8bac-59db7d7d457c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:07.621826 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-55c62a2e-508c-45d4-9747-42041639e483 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:07.622587 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-55c62a2e-508c-45d4-9747-42041639e483 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: d1d08b5f-9032-4848-ba25-122cd62f1432] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:07.640376 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-55c62a2e-508c-45d4-9747-42041639e483 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:07.643480 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-55c62a2e-508c-45d4-9747-42041639e483 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:07.644428 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-55c62a2e-508c-45d4-9747-42041639e483 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:07.645415 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-55c62a2e-508c-45d4-9747-42041639e483 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:07.647617 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-55c62a2e-508c-45d4-9747-42041639e483 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:07.648307 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-55c62a2e-508c-45d4-9747-42041639e483 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:07.692991 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4769a6f7-04c3-453d-8bac-59db7d7d457c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:07.693652 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4769a6f7-04c3-453d-8bac-59db7d7d457c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:07.694950 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4769a6f7-04c3-453d-8bac-59db7d7d457c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:07.694950 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.objects.instance [None req-4769a6f7-04c3-453d-8bac-59db7d7d457c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lazy-loading 'fault' on Instance uuid 3d5f7818-14ce-4b6d-b040-6924c777d0d0 {{(pid=132076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 03:56:07.768815 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-4769a6f7-04c3-453d-8bac-59db7d7d457c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58361634962b4b7884d51be90b683b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12347de4d2e5465b9a00004084fcb85c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:07.780163 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-4769a6f7-04c3-453d-8bac-59db7d7d457c tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0" status: 200 len: 1327 microversion: 2.1 time: 0.206485 Sep 03 03:56:07.782359 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 456/927] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:56:07 2022] GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0 => generated 1327 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 03:56:07.846235 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-55c62a2e-508c-45d4-9747-42041639e483 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde7fad075145c89f726ca85c6c00ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9e77355ba040bda4f2186753df7b24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:07.857543 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-55c62a2e-508c-45d4-9747-42041639e483 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432" status: 200 len: 1612 microversion: 2.1 time: 0.241725 Sep 03 03:56:07.864081 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 472/928] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:56:07 2022] GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432 => generated 1612 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:56:07.967484 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-870fe08e-d1e7-4cd1-9d98-79d6e2fcfa38 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:07.968454 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-870fe08e-d1e7-4cd1-9d98-79d6e2fcfa38 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] [instance: ed64ff03-ce00-49c3-868e-32a0be3fa6bf] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:07.978132 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-870fe08e-d1e7-4cd1-9d98-79d6e2fcfa38 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:07.979099 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-870fe08e-d1e7-4cd1-9d98-79d6e2fcfa38 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:07.980881 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-870fe08e-d1e7-4cd1-9d98-79d6e2fcfa38 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:07.982369 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-870fe08e-d1e7-4cd1-9d98-79d6e2fcfa38 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:07.983837 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-870fe08e-d1e7-4cd1-9d98-79d6e2fcfa38 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:07.985098 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-870fe08e-d1e7-4cd1-9d98-79d6e2fcfa38 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:08.190521 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-870fe08e-d1e7-4cd1-9d98-79d6e2fcfa38 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5594b2c1a2fd4bf8ad2f1c5d2c05b777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f83c7b81a54c9a936f140ca94e3d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:08.200865 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-870fe08e-d1e7-4cd1-9d98-79d6e2fcfa38 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] 10.222.0.25 "GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf" status: 200 len: 1314 microversion: 2.1 time: 0.242489 Sep 03 03:56:08.215985 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 457/929] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:56:07 2022] GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:56:08.810998 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-ad20cfcb-dafc-4ea7-958f-9ba8e13f0087 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:08.811696 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-ad20cfcb-dafc-4ea7-958f-9ba8e13f0087 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 3d5f7818-14ce-4b6d-b040-6924c777d0d0] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:08.818480 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ad20cfcb-dafc-4ea7-958f-9ba8e13f0087 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:08.819084 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ad20cfcb-dafc-4ea7-958f-9ba8e13f0087 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:08.819509 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ad20cfcb-dafc-4ea7-958f-9ba8e13f0087 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:08.820211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ad20cfcb-dafc-4ea7-958f-9ba8e13f0087 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:08.820662 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ad20cfcb-dafc-4ea7-958f-9ba8e13f0087 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:08.821082 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ad20cfcb-dafc-4ea7-958f-9ba8e13f0087 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:08.834585 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.wsgi [None req-ad20cfcb-dafc-4ea7-958f-9ba8e13f0087 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] HTTP exception thrown: Instance 3d5f7818-14ce-4b6d-b040-6924c777d0d0 could not be found. Sep 03 03:56:08.836262 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-ad20cfcb-dafc-4ea7-958f-9ba8e13f0087 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Request method failure captured: Sep 03 03:56:08.836262 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: request: GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0 HTTP/1.1 Sep 03 03:56:08.836262 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept: application/json Sep 03 03:56:08.836262 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept-Encoding: identity Sep 03 03:56:08.836262 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Connection: close Sep 03 03:56:08.836262 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Length: 0 Sep 03 03:56:08.836262 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Type: application/json Sep 03 03:56:08.836262 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Host: 10.222.0.25 Sep 03 03:56:08.836262 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Openstack-System-Scope: None Sep 03 03:56:08.836262 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: User-Agent: python-urllib3/1.26.12 Sep 03 03:56:08.836262 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Auth-Token: gAAAAABjEs64h6RVIvypCuKugbvW3Y7YAUFh7VDm91768lXtoPaqdzXS-_Qkyi2f6kf4lWcyQskEslSa54oS5rrkvI6NoqAIJDoRzC5rEgPQNhr4ZiyVkcp4VnwUB_Yw3zT1bWPH1f6QhT2mQz0SvBXVUEG1SgHfD7qElRNuEWp7DrnjHzS2V-s Sep 03 03:56:08.836262 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Id: None Sep 03 03:56:08.836262 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Name: None Sep 03 03:56:08.836262 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Identity-Status: Confirmed Sep 03 03:56:08.836262 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Is-Admin-Project: True Sep 03 03:56:08.836262 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Id: default Sep 03 03:56:08.836262 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Name: Default Sep 03 03:56:08.836262 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Id: 12347de4d2e5465b9a00004084fcb85c Sep 03 03:56:08.836262 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Name: tempest-AttachVolumeTestJSON-1489543824 Sep 03 03:56:08.836262 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Role: member,reader Sep 03 03:56:08.836262 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Roles: member,reader Sep 03 03:56:08.837872 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12347de4d2e5465b9a00004084fcb85c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_12347de4d2e5465b9a00004084fcb85c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/12347de4d2e5465b9a00004084fcb85c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12347de4d2e5465b9a00004084fcb85c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:56:08.837872 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant: tempest-AttachVolumeTestJSON-1489543824 Sep 03 03:56:08.837872 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Id: 12347de4d2e5465b9a00004084fcb85c Sep 03 03:56:08.837872 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1489543824 Sep 03 03:56:08.837872 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User: tempest-AttachVolumeTestJSON-1489543824-project Sep 03 03:56:08.837872 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Id: default Sep 03 03:56:08.837872 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Name: Default Sep 03 03:56:08.837872 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Id: 58361634962b4b7884d51be90b683b42 Sep 03 03:56:08.837872 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Name: tempest-AttachVolumeTestJSON-1489543824-project Sep 03 03:56:08.837872 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: method: > Sep 03 03:56:08.837872 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: exception: Instance 3d5f7818-14ce-4b6d-b040-6924c777d0d0 could not be found. Sep 03 03:56:08.837872 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: action_args: {'id': '3d5f7818-14ce-4b6d-b040-6924c777d0d0'} Sep 03 03:56:08.838890 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:56:08.838890 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:08.838890 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 03:56:08.838890 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 03:56:08.838890 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 03:56:08.838890 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 03:56:08.838890 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 03:56:08.838890 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 03:56:08.838890 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 03:56:08.838890 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 03:56:08.838890 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d5f7818-14ce-4b6d-b040-6924c777d0d0 could not be found. Sep 03 03:56:08.838890 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:08.838890 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:08.838890 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:08.838890 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:08.838890 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:08.838890 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:08.838890 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:56:08.838890 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:56:08.838890 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:56:08.840304 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:56:08.840304 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 03:56:08.840304 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 03:56:08.840304 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 03:56:08.840304 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 03:56:08.840304 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 03:56:08.840304 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:56:08.840304 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d5f7818-14ce-4b6d-b040-6924c777d0d0 could not be found. Sep 03 03:56:08.840304 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:08.840304 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:08.840304 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:08.840304 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:08.840304 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:08.840304 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:08.840304 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:56:08.840304 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:56:08.840304 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d5f7818-14ce-4b6d-b040-6924c777d0d0 could not be found. Sep 03 03:56:08.840304 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:08.841631 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-ad20cfcb-dafc-4ea7-958f-9ba8e13f0087 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Returning 404 to user: Instance 3d5f7818-14ce-4b6d-b040-6924c777d0d0 could not be found. {{(pid=132077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:56:08.841631 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-ad20cfcb-dafc-4ea7-958f-9ba8e13f0087 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0" status: 404 len: 111 microversion: 2.1 time: 0.030764 Sep 03 03:56:08.841631 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 473/930] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:56:08 2022] GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 03:56:08.846623 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-b78ff9d8-beb4-4dad-9414-4a9cb1bed6ab tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '.version_select at 0x7f45fc4f8160>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:08.867218 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-b78ff9d8-beb4-4dad-9414-4a9cb1bed6ab tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-153976151" status: 202 len: 0 microversion: 2.1 time: 0.024214 Sep 03 03:56:08.867820 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 458/931] 10.222.0.25 () {58 vars in 1218 bytes} [Sat Sep 3 03:56:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-153976151 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 03 03:56:08.881726 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-d8940e47-6722-4cac-ab96-72400ed09eec tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:08.882329 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-d8940e47-6722-4cac-ab96-72400ed09eec tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: d1d08b5f-9032-4848-ba25-122cd62f1432] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:08.888811 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d8940e47-6722-4cac-ab96-72400ed09eec tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:08.889257 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d8940e47-6722-4cac-ab96-72400ed09eec tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:08.889737 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d8940e47-6722-4cac-ab96-72400ed09eec tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:08.890414 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d8940e47-6722-4cac-ab96-72400ed09eec tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:08.890938 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d8940e47-6722-4cac-ab96-72400ed09eec tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:08.891662 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d8940e47-6722-4cac-ab96-72400ed09eec tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:08.906326 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.wsgi [None req-d8940e47-6722-4cac-ab96-72400ed09eec tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] HTTP exception thrown: Instance d1d08b5f-9032-4848-ba25-122cd62f1432 could not be found. Sep 03 03:56:08.907927 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-d8940e47-6722-4cac-ab96-72400ed09eec tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Request method failure captured: Sep 03 03:56:08.907927 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: request: GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432 HTTP/1.1 Sep 03 03:56:08.907927 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept: application/json Sep 03 03:56:08.907927 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept-Encoding: identity Sep 03 03:56:08.907927 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Connection: close Sep 03 03:56:08.907927 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Length: 0 Sep 03 03:56:08.907927 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Type: application/json Sep 03 03:56:08.907927 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Host: 10.222.0.25 Sep 03 03:56:08.907927 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Openstack-System-Scope: None Sep 03 03:56:08.907927 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: User-Agent: python-urllib3/1.26.12 Sep 03 03:56:08.907927 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Auth-Token: gAAAAABjEs650LfhdeTARTcps2T6trtQQt2m5icunzzvIWer-eUYgJYZG5Pjv6m6uWkZdMglMW7-SwnvvwA9dyIFe0GhqjthXj4rFLg5_wGV22DwN7Tu1nE8T--OP86NZDND7AUMPsZwRHed6vQjd_qeShmm1sU59yMmrfP4r0ItLtiNkEQOrd0 Sep 03 03:56:08.907927 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Id: None Sep 03 03:56:08.907927 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Name: None Sep 03 03:56:08.907927 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Identity-Status: Confirmed Sep 03 03:56:08.907927 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Is-Admin-Project: True Sep 03 03:56:08.907927 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Id: default Sep 03 03:56:08.907927 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Name: Default Sep 03 03:56:08.907927 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Id: ac9e77355ba040bda4f2186753df7b24 Sep 03 03:56:08.907927 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Name: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:56:08.907927 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Role: member,reader Sep 03 03:56:08.907927 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Roles: member,reader Sep 03 03:56:08.909566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:56:08.909566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:56:08.909566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Id: ac9e77355ba040bda4f2186753df7b24 Sep 03 03:56:08.909566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:56:08.909566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User: tempest-AttachVolumeNegativeTest-1116033749-project Sep 03 03:56:08.909566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Id: default Sep 03 03:56:08.909566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Name: Default Sep 03 03:56:08.909566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Id: 1dde7fad075145c89f726ca85c6c00ba Sep 03 03:56:08.909566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Name: tempest-AttachVolumeNegativeTest-1116033749-project Sep 03 03:56:08.909566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: method: > Sep 03 03:56:08.909566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: exception: Instance d1d08b5f-9032-4848-ba25-122cd62f1432 could not be found. Sep 03 03:56:08.909566 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: action_args: {'id': 'd1d08b5f-9032-4848-ba25-122cd62f1432'} Sep 03 03:56:08.910403 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:56:08.910403 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:08.910403 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 03:56:08.910403 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 03:56:08.910403 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 03:56:08.910403 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 03:56:08.910403 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 03:56:08.910403 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 03:56:08.910403 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 03:56:08.910403 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 03:56:08.910403 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1d08b5f-9032-4848-ba25-122cd62f1432 could not be found. Sep 03 03:56:08.910403 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:08.910403 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:08.910403 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:08.910403 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:08.910403 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:08.910403 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:08.910403 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:56:08.910403 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:56:08.910403 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:56:08.911622 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:56:08.911622 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 03:56:08.911622 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 03:56:08.911622 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 03:56:08.911622 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 03:56:08.911622 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 03:56:08.911622 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:56:08.911622 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1d08b5f-9032-4848-ba25-122cd62f1432 could not be found. Sep 03 03:56:08.911622 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:08.911622 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:08.911622 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:08.911622 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:08.911622 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:08.911622 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:08.911622 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:56:08.911622 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:56:08.911622 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1d08b5f-9032-4848-ba25-122cd62f1432 could not be found. Sep 03 03:56:08.911622 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:08.912791 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-d8940e47-6722-4cac-ab96-72400ed09eec tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Returning 404 to user: Instance d1d08b5f-9032-4848-ba25-122cd62f1432 could not be found. {{(pid=132077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:56:08.912791 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-d8940e47-6722-4cac-ab96-72400ed09eec tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432" status: 404 len: 111 microversion: 2.1 time: 0.031553 Sep 03 03:56:08.912791 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 474/932] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:56:08 2022] GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 03:56:08.918746 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-b0f3a15e-3a16-4292-9e67-3f9f4244612e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '.version_select at 0x7f45fff13310>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:08.941066 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-b0f3a15e-3a16-4292-9e67-3f9f4244612e tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-777163056" status: 202 len: 0 microversion: 2.1 time: 0.025982 Sep 03 03:56:08.941653 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 459/933] 10.222.0.25 () {58 vars in 1218 bytes} [Sat Sep 3 03:56:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-777163056 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 03:56:09.226650 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-03f2f6a4-d364-45ec-9eb3-f86bca1ef9d1 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:09.227551 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-03f2f6a4-d364-45ec-9eb3-f86bca1ef9d1 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] [instance: ed64ff03-ce00-49c3-868e-32a0be3fa6bf] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:09.239468 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-03f2f6a4-d364-45ec-9eb3-f86bca1ef9d1 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:09.239989 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-03f2f6a4-d364-45ec-9eb3-f86bca1ef9d1 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:09.240432 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-03f2f6a4-d364-45ec-9eb3-f86bca1ef9d1 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:09.241295 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-03f2f6a4-d364-45ec-9eb3-f86bca1ef9d1 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:09.241730 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-03f2f6a4-d364-45ec-9eb3-f86bca1ef9d1 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:09.242153 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-03f2f6a4-d364-45ec-9eb3-f86bca1ef9d1 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:09.549396 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-03f2f6a4-d364-45ec-9eb3-f86bca1ef9d1 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5594b2c1a2fd4bf8ad2f1c5d2c05b777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f83c7b81a54c9a936f140ca94e3d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:09.557704 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-03f2f6a4-d364-45ec-9eb3-f86bca1ef9d1 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] 10.222.0.25 "GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf" status: 200 len: 1314 microversion: 2.1 time: 0.334924 Sep 03 03:56:09.558386 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 475/934] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:56:09 2022] GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:56:09.642219 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-b2ce374f-c4e9-4317-af21-0d7adcaab263 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:09.642738 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-b2ce374f-c4e9-4317-af21-0d7adcaab263 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:09.649179 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b2ce374f-c4e9-4317-af21-0d7adcaab263 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:09.649673 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b2ce374f-c4e9-4317-af21-0d7adcaab263 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:09.650109 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b2ce374f-c4e9-4317-af21-0d7adcaab263 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:09.650909 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b2ce374f-c4e9-4317-af21-0d7adcaab263 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:09.651287 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b2ce374f-c4e9-4317-af21-0d7adcaab263 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:09.651741 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b2ce374f-c4e9-4317-af21-0d7adcaab263 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:09.666513 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.wsgi [None req-b2ce374f-c4e9-4317-af21-0d7adcaab263 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] HTTP exception thrown: Instance cc53cf40-e9bf-4403-92b0-7bae49adae43 could not be found. Sep 03 03:56:09.668265 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-b2ce374f-c4e9-4317-af21-0d7adcaab263 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Request method failure captured: Sep 03 03:56:09.668265 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: request: DELETE /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 HTTP/1.1 Sep 03 03:56:09.668265 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept: application/json Sep 03 03:56:09.668265 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept-Encoding: identity Sep 03 03:56:09.668265 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Connection: close Sep 03 03:56:09.668265 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Length: 0 Sep 03 03:56:09.668265 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Type: application/json Sep 03 03:56:09.668265 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Host: 10.222.0.25 Sep 03 03:56:09.668265 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Openstack-System-Scope: None Sep 03 03:56:09.668265 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: User-Agent: python-urllib3/1.26.12 Sep 03 03:56:09.668265 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Auth-Token: gAAAAABjEs69BRGC6P6wBJAUTmtITvT_vIw0gPds8bq0Ck7UAz1bo7CB8mFb-VFBiBFm8hZHRYtPTy2K0wjbLuKWVIEOTzAutTGmbrr-bFM_gcnv-f2-BjsF6yImlUNPqD-nULDssJKi4jaJ6RtDHDHo4FVzgRyBXvdxlqqtKqS0j7ZF8HSGrRo Sep 03 03:56:09.668265 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Id: None Sep 03 03:56:09.668265 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Name: None Sep 03 03:56:09.668265 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Identity-Status: Confirmed Sep 03 03:56:09.668265 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Is-Admin-Project: True Sep 03 03:56:09.668265 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Openstack-Nova-Api-Version: 2.20 Sep 03 03:56:09.668265 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Id: default Sep 03 03:56:09.668265 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Name: Default Sep 03 03:56:09.668265 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Id: 4d80eadc5cc34322b85201c50b3c6552 Sep 03 03:56:09.668265 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1191556674 Sep 03 03:56:09.668265 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Role: member,reader Sep 03 03:56:09.668265 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Roles: member,reader Sep 03 03:56:09.670003 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d80eadc5cc34322b85201c50b3c6552"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4d80eadc5cc34322b85201c50b3c6552"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4d80eadc5cc34322b85201c50b3c6552"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d80eadc5cc34322b85201c50b3c6552"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:56:09.670003 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1191556674 Sep 03 03:56:09.670003 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Id: 4d80eadc5cc34322b85201c50b3c6552 Sep 03 03:56:09.670003 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1191556674 Sep 03 03:56:09.670003 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User: tempest-AttachVolumeShelveTestJSON-1191556674-project Sep 03 03:56:09.670003 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Id: default Sep 03 03:56:09.670003 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Name: Default Sep 03 03:56:09.670003 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Id: 31a8c62bd81f4c1f863bd952b6976276 Sep 03 03:56:09.670003 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1191556674-project Sep 03 03:56:09.670003 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: method: > Sep 03 03:56:09.670003 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: exception: Instance cc53cf40-e9bf-4403-92b0-7bae49adae43 could not be found. Sep 03 03:56:09.670003 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: action_args: {'id': 'cc53cf40-e9bf-4403-92b0-7bae49adae43'} Sep 03 03:56:09.670952 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:56:09.670952 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:09.670952 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 03:56:09.670952 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 03:56:09.670952 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 03:56:09.670952 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 03:56:09.670952 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 03:56:09.670952 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 03:56:09.670952 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 03:56:09.670952 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 03:56:09.670952 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc53cf40-e9bf-4403-92b0-7bae49adae43 could not be found. Sep 03 03:56:09.670952 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:09.670952 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:09.670952 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:09.670952 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:09.670952 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:09.670952 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:09.670952 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:56:09.670952 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:56:09.670952 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:56:09.672500 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:56:09.672500 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 03:56:09.672500 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 03:56:09.672500 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 03:56:09.672500 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 03:56:09.672500 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 03:56:09.672500 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 03:56:09.672500 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 03:56:09.672500 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:56:09.672500 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc53cf40-e9bf-4403-92b0-7bae49adae43 could not be found. Sep 03 03:56:09.672500 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:09.672500 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:09.672500 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:09.672500 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:09.672500 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:09.672500 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:09.672500 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:56:09.672500 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:56:09.672500 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc53cf40-e9bf-4403-92b0-7bae49adae43 could not be found. Sep 03 03:56:09.672500 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:09.673977 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-b2ce374f-c4e9-4317-af21-0d7adcaab263 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Returning 404 to user: Instance cc53cf40-e9bf-4403-92b0-7bae49adae43 could not be found. {{(pid=132076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:56:09.673977 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-b2ce374f-c4e9-4317-af21-0d7adcaab263 tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 404 len: 111 microversion: 2.20 time: 0.031484 Sep 03 03:56:09.673977 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 460/935] 10.222.0.25 () {60 vars in 1280 bytes} [Sat Sep 3 03:56:09 2022] DELETE /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 03 03:56:09.680327 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-79d9eca4-f79d-4852-b552-54354ad12b3c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:09.681166 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-79d9eca4-f79d-4852-b552-54354ad12b3c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: cc53cf40-e9bf-4403-92b0-7bae49adae43] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:09.687751 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-79d9eca4-f79d-4852-b552-54354ad12b3c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:09.688216 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-79d9eca4-f79d-4852-b552-54354ad12b3c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:09.688632 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-79d9eca4-f79d-4852-b552-54354ad12b3c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:09.689327 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-79d9eca4-f79d-4852-b552-54354ad12b3c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:09.689775 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-79d9eca4-f79d-4852-b552-54354ad12b3c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:09.690191 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-79d9eca4-f79d-4852-b552-54354ad12b3c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:09.704070 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.wsgi [None req-79d9eca4-f79d-4852-b552-54354ad12b3c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] HTTP exception thrown: Instance cc53cf40-e9bf-4403-92b0-7bae49adae43 could not be found. Sep 03 03:56:09.705614 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-79d9eca4-f79d-4852-b552-54354ad12b3c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Request method failure captured: Sep 03 03:56:09.705614 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: request: GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 HTTP/1.1 Sep 03 03:56:09.705614 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept: application/json Sep 03 03:56:09.705614 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept-Encoding: identity Sep 03 03:56:09.705614 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Connection: close Sep 03 03:56:09.705614 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Length: 0 Sep 03 03:56:09.705614 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Type: application/json Sep 03 03:56:09.705614 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Host: 10.222.0.25 Sep 03 03:56:09.705614 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Openstack-System-Scope: None Sep 03 03:56:09.705614 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: User-Agent: python-urllib3/1.26.12 Sep 03 03:56:09.705614 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Auth-Token: gAAAAABjEs69BRGC6P6wBJAUTmtITvT_vIw0gPds8bq0Ck7UAz1bo7CB8mFb-VFBiBFm8hZHRYtPTy2K0wjbLuKWVIEOTzAutTGmbrr-bFM_gcnv-f2-BjsF6yImlUNPqD-nULDssJKi4jaJ6RtDHDHo4FVzgRyBXvdxlqqtKqS0j7ZF8HSGrRo Sep 03 03:56:09.705614 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Id: None Sep 03 03:56:09.705614 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Name: None Sep 03 03:56:09.705614 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Identity-Status: Confirmed Sep 03 03:56:09.705614 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Is-Admin-Project: True Sep 03 03:56:09.705614 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Openstack-Nova-Api-Version: 2.20 Sep 03 03:56:09.705614 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Id: default Sep 03 03:56:09.705614 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Name: Default Sep 03 03:56:09.705614 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Id: 4d80eadc5cc34322b85201c50b3c6552 Sep 03 03:56:09.705614 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1191556674 Sep 03 03:56:09.705614 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Role: member,reader Sep 03 03:56:09.705614 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Roles: member,reader Sep 03 03:56:09.707289 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d80eadc5cc34322b85201c50b3c6552"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4d80eadc5cc34322b85201c50b3c6552"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4d80eadc5cc34322b85201c50b3c6552"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d80eadc5cc34322b85201c50b3c6552"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:56:09.707289 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1191556674 Sep 03 03:56:09.707289 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Id: 4d80eadc5cc34322b85201c50b3c6552 Sep 03 03:56:09.707289 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1191556674 Sep 03 03:56:09.707289 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User: tempest-AttachVolumeShelveTestJSON-1191556674-project Sep 03 03:56:09.707289 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Id: default Sep 03 03:56:09.707289 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Name: Default Sep 03 03:56:09.707289 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Id: 31a8c62bd81f4c1f863bd952b6976276 Sep 03 03:56:09.707289 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1191556674-project Sep 03 03:56:09.707289 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: method: > Sep 03 03:56:09.707289 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: exception: Instance cc53cf40-e9bf-4403-92b0-7bae49adae43 could not be found. Sep 03 03:56:09.707289 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: action_args: {'id': 'cc53cf40-e9bf-4403-92b0-7bae49adae43'} Sep 03 03:56:09.708180 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:56:09.708180 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:09.708180 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 03:56:09.708180 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 03:56:09.708180 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 03:56:09.708180 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 03:56:09.708180 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 03:56:09.708180 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 03:56:09.708180 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 03:56:09.708180 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 03:56:09.708180 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc53cf40-e9bf-4403-92b0-7bae49adae43 could not be found. Sep 03 03:56:09.708180 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:09.708180 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:09.708180 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:09.708180 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:09.708180 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:09.708180 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:09.708180 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:56:09.708180 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:56:09.708180 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:56:09.709724 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:56:09.709724 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 03:56:09.709724 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 03:56:09.709724 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 03:56:09.709724 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 03:56:09.709724 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 03:56:09.709724 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:56:09.709724 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc53cf40-e9bf-4403-92b0-7bae49adae43 could not be found. Sep 03 03:56:09.709724 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:09.709724 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:09.709724 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:09.709724 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:09.709724 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:09.709724 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:09.709724 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:56:09.709724 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:56:09.709724 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc53cf40-e9bf-4403-92b0-7bae49adae43 could not be found. Sep 03 03:56:09.709724 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:09.711678 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-79d9eca4-f79d-4852-b552-54354ad12b3c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Returning 404 to user: Instance cc53cf40-e9bf-4403-92b0-7bae49adae43 could not be found. {{(pid=132077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:56:09.712659 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-79d9eca4-f79d-4852-b552-54354ad12b3c tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43" status: 404 len: 111 microversion: 2.20 time: 0.037045 Sep 03 03:56:09.713206 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 476/936] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:56:09 2022] GET /compute/v2.1/servers/cc53cf40-e9bf-4403-92b0-7bae49adae43 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 03 03:56:10.586588 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-6cfb1b39-32e4-4dfa-badf-5f5611867ead tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:10.587289 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-6cfb1b39-32e4-4dfa-badf-5f5611867ead tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] [instance: ed64ff03-ce00-49c3-868e-32a0be3fa6bf] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:10.595458 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6cfb1b39-32e4-4dfa-badf-5f5611867ead tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:10.596049 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6cfb1b39-32e4-4dfa-badf-5f5611867ead tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:10.596584 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6cfb1b39-32e4-4dfa-badf-5f5611867ead tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:10.597439 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6cfb1b39-32e4-4dfa-badf-5f5611867ead tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:10.597989 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6cfb1b39-32e4-4dfa-badf-5f5611867ead tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:10.598558 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6cfb1b39-32e4-4dfa-badf-5f5611867ead tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:10.760674 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-6cfb1b39-32e4-4dfa-badf-5f5611867ead tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5594b2c1a2fd4bf8ad2f1c5d2c05b777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f83c7b81a54c9a936f140ca94e3d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:10.768731 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-6cfb1b39-32e4-4dfa-badf-5f5611867ead tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] 10.222.0.25 "GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf" status: 200 len: 1314 microversion: 2.1 time: 0.188728 Sep 03 03:56:10.769292 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 461/937] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:56:10 2022] GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:56:10.862675 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-4bd88a8c-231b-4590-8592-13dc404808cc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:10.863147 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-4bd88a8c-231b-4590-8592-13dc404808cc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:10.870019 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4bd88a8c-231b-4590-8592-13dc404808cc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:10.870495 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4bd88a8c-231b-4590-8592-13dc404808cc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:10.870932 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4bd88a8c-231b-4590-8592-13dc404808cc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:10.871662 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4bd88a8c-231b-4590-8592-13dc404808cc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:10.872111 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4bd88a8c-231b-4590-8592-13dc404808cc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:10.872536 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4bd88a8c-231b-4590-8592-13dc404808cc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:10.886499 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.wsgi [None req-4bd88a8c-231b-4590-8592-13dc404808cc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] HTTP exception thrown: Instance 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 could not be found. Sep 03 03:56:10.888120 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-4bd88a8c-231b-4590-8592-13dc404808cc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Request method failure captured: Sep 03 03:56:10.888120 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: request: DELETE /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 HTTP/1.1 Sep 03 03:56:10.888120 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept: application/json Sep 03 03:56:10.888120 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept-Encoding: identity Sep 03 03:56:10.888120 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Connection: close Sep 03 03:56:10.888120 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Length: 0 Sep 03 03:56:10.888120 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Type: application/json Sep 03 03:56:10.888120 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Host: 10.222.0.25 Sep 03 03:56:10.888120 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Openstack-System-Scope: None Sep 03 03:56:10.888120 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: User-Agent: python-urllib3/1.26.12 Sep 03 03:56:10.888120 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Auth-Token: gAAAAABjEs69BRGC6P6wBJAUTmtITvT_vIw0gPds8bq0Ck7UAz1bo7CB8mFb-VFBiBFm8hZHRYtPTy2K0wjbLuKWVIEOTzAutTGmbrr-bFM_gcnv-f2-BjsF6yImlUNPqD-nULDssJKi4jaJ6RtDHDHo4FVzgRyBXvdxlqqtKqS0j7ZF8HSGrRo Sep 03 03:56:10.888120 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Id: None Sep 03 03:56:10.888120 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Name: None Sep 03 03:56:10.888120 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Identity-Status: Confirmed Sep 03 03:56:10.888120 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Is-Admin-Project: True Sep 03 03:56:10.888120 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Openstack-Nova-Api-Version: 2.20 Sep 03 03:56:10.888120 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Id: default Sep 03 03:56:10.888120 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Name: Default Sep 03 03:56:10.888120 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Id: 4d80eadc5cc34322b85201c50b3c6552 Sep 03 03:56:10.888120 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1191556674 Sep 03 03:56:10.888120 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Role: member,reader Sep 03 03:56:10.888120 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Roles: member,reader Sep 03 03:56:10.889704 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d80eadc5cc34322b85201c50b3c6552"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4d80eadc5cc34322b85201c50b3c6552"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4d80eadc5cc34322b85201c50b3c6552"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d80eadc5cc34322b85201c50b3c6552"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:56:10.889704 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1191556674 Sep 03 03:56:10.889704 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Id: 4d80eadc5cc34322b85201c50b3c6552 Sep 03 03:56:10.889704 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1191556674 Sep 03 03:56:10.889704 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User: tempest-AttachVolumeShelveTestJSON-1191556674-project Sep 03 03:56:10.889704 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Id: default Sep 03 03:56:10.889704 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Name: Default Sep 03 03:56:10.889704 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Id: 31a8c62bd81f4c1f863bd952b6976276 Sep 03 03:56:10.889704 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1191556674-project Sep 03 03:56:10.889704 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: method: > Sep 03 03:56:10.889704 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: exception: Instance 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 could not be found. Sep 03 03:56:10.889704 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: action_args: {'id': '52d61f1c-d865-4d0d-89a9-1f91f0f8bf78'} Sep 03 03:56:10.890564 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:56:10.890564 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:10.890564 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 03:56:10.890564 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 03:56:10.890564 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 03:56:10.890564 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 03:56:10.890564 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 03:56:10.890564 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 03:56:10.890564 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 03:56:10.890564 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 03:56:10.890564 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 could not be found. Sep 03 03:56:10.890564 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:10.890564 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:10.890564 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:10.890564 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:10.890564 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:10.890564 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:10.890564 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:56:10.890564 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:56:10.890564 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:56:10.891960 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:56:10.891960 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 03:56:10.891960 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 03:56:10.891960 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 03:56:10.891960 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 03:56:10.891960 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 03:56:10.891960 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 03:56:10.891960 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 03:56:10.891960 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:56:10.891960 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 could not be found. Sep 03 03:56:10.891960 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:10.891960 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:10.891960 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:10.891960 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:10.891960 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:10.891960 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:10.891960 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:56:10.891960 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:56:10.891960 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 could not be found. Sep 03 03:56:10.891960 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:10.893748 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-4bd88a8c-231b-4590-8592-13dc404808cc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Returning 404 to user: Instance 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 could not be found. {{(pid=132077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:56:10.893748 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-4bd88a8c-231b-4590-8592-13dc404808cc tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "DELETE /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 404 len: 111 microversion: 2.20 time: 0.030688 Sep 03 03:56:10.893748 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 477/938] 10.222.0.25 () {60 vars in 1280 bytes} [Sat Sep 3 03:56:10 2022] DELETE /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 03 03:56:10.897969 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-ef9ae0da-390f-43f4-8a5a-a3d2a622c0db tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:10.898825 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-ef9ae0da-390f-43f4-8a5a-a3d2a622c0db tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] [instance: 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:10.905189 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ef9ae0da-390f-43f4-8a5a-a3d2a622c0db tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:10.905775 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ef9ae0da-390f-43f4-8a5a-a3d2a622c0db tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:10.906074 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ef9ae0da-390f-43f4-8a5a-a3d2a622c0db tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:10.906763 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ef9ae0da-390f-43f4-8a5a-a3d2a622c0db tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:10.907242 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ef9ae0da-390f-43f4-8a5a-a3d2a622c0db tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:10.907722 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-ef9ae0da-390f-43f4-8a5a-a3d2a622c0db tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:10.922842 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.wsgi [None req-ef9ae0da-390f-43f4-8a5a-a3d2a622c0db tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] HTTP exception thrown: Instance 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 could not be found. Sep 03 03:56:10.924386 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-ef9ae0da-390f-43f4-8a5a-a3d2a622c0db tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Request method failure captured: Sep 03 03:56:10.924386 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: request: GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 HTTP/1.1 Sep 03 03:56:10.924386 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept: application/json Sep 03 03:56:10.924386 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept-Encoding: identity Sep 03 03:56:10.924386 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Connection: close Sep 03 03:56:10.924386 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Length: 0 Sep 03 03:56:10.924386 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Type: application/json Sep 03 03:56:10.924386 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Host: 10.222.0.25 Sep 03 03:56:10.924386 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Openstack-System-Scope: None Sep 03 03:56:10.924386 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: User-Agent: python-urllib3/1.26.12 Sep 03 03:56:10.924386 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Auth-Token: gAAAAABjEs69BRGC6P6wBJAUTmtITvT_vIw0gPds8bq0Ck7UAz1bo7CB8mFb-VFBiBFm8hZHRYtPTy2K0wjbLuKWVIEOTzAutTGmbrr-bFM_gcnv-f2-BjsF6yImlUNPqD-nULDssJKi4jaJ6RtDHDHo4FVzgRyBXvdxlqqtKqS0j7ZF8HSGrRo Sep 03 03:56:10.924386 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Id: None Sep 03 03:56:10.924386 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Name: None Sep 03 03:56:10.924386 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Identity-Status: Confirmed Sep 03 03:56:10.924386 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Is-Admin-Project: True Sep 03 03:56:10.924386 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Openstack-Nova-Api-Version: 2.20 Sep 03 03:56:10.924386 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Id: default Sep 03 03:56:10.924386 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Name: Default Sep 03 03:56:10.924386 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Id: 4d80eadc5cc34322b85201c50b3c6552 Sep 03 03:56:10.924386 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1191556674 Sep 03 03:56:10.924386 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Role: member,reader Sep 03 03:56:10.924386 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Roles: member,reader Sep 03 03:56:10.926076 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d80eadc5cc34322b85201c50b3c6552"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4d80eadc5cc34322b85201c50b3c6552"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4d80eadc5cc34322b85201c50b3c6552"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d80eadc5cc34322b85201c50b3c6552"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:56:10.926076 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1191556674 Sep 03 03:56:10.926076 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Id: 4d80eadc5cc34322b85201c50b3c6552 Sep 03 03:56:10.926076 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1191556674 Sep 03 03:56:10.926076 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User: tempest-AttachVolumeShelveTestJSON-1191556674-project Sep 03 03:56:10.926076 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Id: default Sep 03 03:56:10.926076 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Name: Default Sep 03 03:56:10.926076 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Id: 31a8c62bd81f4c1f863bd952b6976276 Sep 03 03:56:10.926076 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1191556674-project Sep 03 03:56:10.926076 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: method: > Sep 03 03:56:10.926076 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: exception: Instance 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 could not be found. Sep 03 03:56:10.926076 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: action_args: {'id': '52d61f1c-d865-4d0d-89a9-1f91f0f8bf78'} Sep 03 03:56:10.926954 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:56:10.926954 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:10.926954 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 03:56:10.926954 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 03:56:10.926954 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 03:56:10.926954 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 03:56:10.926954 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 03:56:10.926954 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 03:56:10.926954 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 03:56:10.926954 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 03:56:10.926954 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 could not be found. Sep 03 03:56:10.926954 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:10.926954 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:10.926954 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:10.926954 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:10.926954 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:10.926954 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:10.926954 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:56:10.926954 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:56:10.926954 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:56:10.928446 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:56:10.928446 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 03:56:10.928446 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 03:56:10.928446 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 03:56:10.928446 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 03:56:10.928446 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 03:56:10.928446 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:56:10.928446 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 could not be found. Sep 03 03:56:10.928446 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:10.928446 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:10.928446 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:10.928446 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:10.928446 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:10.928446 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:10.928446 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:56:10.928446 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:56:10.928446 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 could not be found. Sep 03 03:56:10.928446 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:10.929932 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-ef9ae0da-390f-43f4-8a5a-a3d2a622c0db tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] Returning 404 to user: Instance 52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 could not be found. {{(pid=132076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:56:10.929932 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-ef9ae0da-390f-43f4-8a5a-a3d2a622c0db tempest-AttachVolumeShelveTestJSON-1191556674 tempest-AttachVolumeShelveTestJSON-1191556674-project] 10.222.0.25 "GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78" status: 404 len: 111 microversion: 2.20 time: 0.031670 Sep 03 03:56:10.929932 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 462/939] 10.222.0.25 () {60 vars in 1277 bytes} [Sat Sep 3 03:56:10 2022] GET /compute/v2.1/servers/52d61f1c-d865-4d0d-89a9-1f91f0f8bf78 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 03 03:56:11.023992 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-48ea59f1-6f08-4611-a391-ea5668495e5c req-659debc8-183a-4d27-83be-d3824ff362e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed64ff03-ce00-49c3-868e-32a0be3fa6bf", "name": "network-vif-plugged", "status": "completed", "tag": "82c62b2e-5cba-4fe3-a25f-2938d6b39233"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:56:11.034135 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-48ea59f1-6f08-4611-a391-ea5668495e5c req-659debc8-183a-4d27-83be-d3824ff362e7 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:11.034728 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-48ea59f1-6f08-4611-a391-ea5668495e5c req-659debc8-183a-4d27-83be-d3824ff362e7 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:11.035297 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-48ea59f1-6f08-4611-a391-ea5668495e5c req-659debc8-183a-4d27-83be-d3824ff362e7 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:11.047280 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-48ea59f1-6f08-4611-a391-ea5668495e5c req-659debc8-183a-4d27-83be-d3824ff362e7 service nova] Creating event network-vif-plugged:82c62b2e-5cba-4fe3-a25f-2938d6b39233 for instance ed64ff03-ce00-49c3-868e-32a0be3fa6bf on hv-cinder-79966 Sep 03 03:56:11.052359 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-48ea59f1-6f08-4611-a391-ea5668495e5c req-659debc8-183a-4d27-83be-d3824ff362e7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032822 Sep 03 03:56:11.053053 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 478/940] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 03:56:11.124219 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-6544dca1-3d1f-4741-90e8-90e799372482 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:11.124708 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-6544dca1-3d1f-4741-90e8-90e799372482 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: d1d08b5f-9032-4848-ba25-122cd62f1432] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:11.131493 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6544dca1-3d1f-4741-90e8-90e799372482 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:11.132254 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6544dca1-3d1f-4741-90e8-90e799372482 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:11.132879 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6544dca1-3d1f-4741-90e8-90e799372482 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:11.134386 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6544dca1-3d1f-4741-90e8-90e799372482 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:11.135071 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6544dca1-3d1f-4741-90e8-90e799372482 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:11.135787 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-6544dca1-3d1f-4741-90e8-90e799372482 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:11.168639 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.wsgi [None req-6544dca1-3d1f-4741-90e8-90e799372482 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] HTTP exception thrown: Instance d1d08b5f-9032-4848-ba25-122cd62f1432 could not be found. Sep 03 03:56:11.170760 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-6544dca1-3d1f-4741-90e8-90e799372482 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Request method failure captured: Sep 03 03:56:11.170760 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: request: DELETE /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432 HTTP/1.1 Sep 03 03:56:11.170760 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept: application/json Sep 03 03:56:11.170760 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept-Encoding: identity Sep 03 03:56:11.170760 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Connection: close Sep 03 03:56:11.170760 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Length: 0 Sep 03 03:56:11.170760 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Type: application/json Sep 03 03:56:11.170760 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Host: 10.222.0.25 Sep 03 03:56:11.170760 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Openstack-System-Scope: None Sep 03 03:56:11.170760 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: User-Agent: python-urllib3/1.26.12 Sep 03 03:56:11.170760 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Auth-Token: gAAAAABjEs650LfhdeTARTcps2T6trtQQt2m5icunzzvIWer-eUYgJYZG5Pjv6m6uWkZdMglMW7-SwnvvwA9dyIFe0GhqjthXj4rFLg5_wGV22DwN7Tu1nE8T--OP86NZDND7AUMPsZwRHed6vQjd_qeShmm1sU59yMmrfP4r0ItLtiNkEQOrd0 Sep 03 03:56:11.170760 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Id: None Sep 03 03:56:11.170760 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Name: None Sep 03 03:56:11.170760 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Identity-Status: Confirmed Sep 03 03:56:11.170760 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Is-Admin-Project: True Sep 03 03:56:11.170760 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Id: default Sep 03 03:56:11.170760 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Name: Default Sep 03 03:56:11.170760 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Id: ac9e77355ba040bda4f2186753df7b24 Sep 03 03:56:11.170760 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Name: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:56:11.170760 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Role: member,reader Sep 03 03:56:11.170760 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Roles: member,reader Sep 03 03:56:11.172592 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:56:11.172592 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:56:11.172592 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Id: ac9e77355ba040bda4f2186753df7b24 Sep 03 03:56:11.172592 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:56:11.172592 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User: tempest-AttachVolumeNegativeTest-1116033749-project Sep 03 03:56:11.172592 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Id: default Sep 03 03:56:11.172592 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Name: Default Sep 03 03:56:11.172592 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Id: 1dde7fad075145c89f726ca85c6c00ba Sep 03 03:56:11.172592 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Name: tempest-AttachVolumeNegativeTest-1116033749-project Sep 03 03:56:11.172592 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: method: > Sep 03 03:56:11.172592 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: exception: Instance d1d08b5f-9032-4848-ba25-122cd62f1432 could not be found. Sep 03 03:56:11.172592 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: action_args: {'id': 'd1d08b5f-9032-4848-ba25-122cd62f1432'} Sep 03 03:56:11.173519 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:56:11.173519 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:11.173519 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 03:56:11.173519 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 03:56:11.173519 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 03:56:11.173519 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 03:56:11.173519 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 03:56:11.173519 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 03:56:11.173519 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 03:56:11.173519 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 03:56:11.173519 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1d08b5f-9032-4848-ba25-122cd62f1432 could not be found. Sep 03 03:56:11.173519 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:11.173519 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:11.173519 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:11.173519 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:11.173519 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:11.173519 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:11.173519 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:56:11.173519 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:56:11.173519 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:56:11.175097 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:56:11.175097 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 03:56:11.175097 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 03:56:11.175097 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 03:56:11.175097 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 03:56:11.175097 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 03:56:11.175097 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 03:56:11.175097 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 03:56:11.175097 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:56:11.175097 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1d08b5f-9032-4848-ba25-122cd62f1432 could not be found. Sep 03 03:56:11.175097 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:11.175097 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:11.175097 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:11.175097 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:11.175097 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:11.175097 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:11.175097 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:56:11.175097 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:56:11.175097 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1d08b5f-9032-4848-ba25-122cd62f1432 could not be found. Sep 03 03:56:11.175097 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:11.176764 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-6544dca1-3d1f-4741-90e8-90e799372482 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Returning 404 to user: Instance d1d08b5f-9032-4848-ba25-122cd62f1432 could not be found. {{(pid=132076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:56:11.176764 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-6544dca1-3d1f-4741-90e8-90e799372482 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432" status: 404 len: 111 microversion: 2.1 time: 0.054581 Sep 03 03:56:11.176764 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 463/941] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Sep 3 03:56:11 2022] DELETE /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 03:56:11.184742 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-3f3aadf3-6c38-4968-8195-b59a3d8c6515 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:11.185556 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-3f3aadf3-6c38-4968-8195-b59a3d8c6515 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: d1d08b5f-9032-4848-ba25-122cd62f1432] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:11.192444 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3f3aadf3-6c38-4968-8195-b59a3d8c6515 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:11.193207 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3f3aadf3-6c38-4968-8195-b59a3d8c6515 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:11.193833 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3f3aadf3-6c38-4968-8195-b59a3d8c6515 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:11.194847 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3f3aadf3-6c38-4968-8195-b59a3d8c6515 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:11.195756 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3f3aadf3-6c38-4968-8195-b59a3d8c6515 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:11.196406 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3f3aadf3-6c38-4968-8195-b59a3d8c6515 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:11.211116 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.wsgi [None req-3f3aadf3-6c38-4968-8195-b59a3d8c6515 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] HTTP exception thrown: Instance d1d08b5f-9032-4848-ba25-122cd62f1432 could not be found. Sep 03 03:56:11.213162 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-3f3aadf3-6c38-4968-8195-b59a3d8c6515 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Request method failure captured: Sep 03 03:56:11.213162 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: request: GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432 HTTP/1.1 Sep 03 03:56:11.213162 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept: application/json Sep 03 03:56:11.213162 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept-Encoding: identity Sep 03 03:56:11.213162 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Connection: close Sep 03 03:56:11.213162 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Length: 0 Sep 03 03:56:11.213162 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Type: application/json Sep 03 03:56:11.213162 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Host: 10.222.0.25 Sep 03 03:56:11.213162 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Openstack-System-Scope: None Sep 03 03:56:11.213162 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: User-Agent: python-urllib3/1.26.12 Sep 03 03:56:11.213162 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Auth-Token: gAAAAABjEs650LfhdeTARTcps2T6trtQQt2m5icunzzvIWer-eUYgJYZG5Pjv6m6uWkZdMglMW7-SwnvvwA9dyIFe0GhqjthXj4rFLg5_wGV22DwN7Tu1nE8T--OP86NZDND7AUMPsZwRHed6vQjd_qeShmm1sU59yMmrfP4r0ItLtiNkEQOrd0 Sep 03 03:56:11.213162 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Id: None Sep 03 03:56:11.213162 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Name: None Sep 03 03:56:11.213162 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Identity-Status: Confirmed Sep 03 03:56:11.213162 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Is-Admin-Project: True Sep 03 03:56:11.213162 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Id: default Sep 03 03:56:11.213162 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Name: Default Sep 03 03:56:11.213162 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Id: ac9e77355ba040bda4f2186753df7b24 Sep 03 03:56:11.213162 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Name: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:56:11.213162 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Role: member,reader Sep 03 03:56:11.213162 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Roles: member,reader Sep 03 03:56:11.214692 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:56:11.214692 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:56:11.214692 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Id: ac9e77355ba040bda4f2186753df7b24 Sep 03 03:56:11.214692 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:56:11.214692 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User: tempest-AttachVolumeNegativeTest-1116033749-project Sep 03 03:56:11.214692 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Id: default Sep 03 03:56:11.214692 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Name: Default Sep 03 03:56:11.214692 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Id: 1dde7fad075145c89f726ca85c6c00ba Sep 03 03:56:11.214692 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Name: tempest-AttachVolumeNegativeTest-1116033749-project Sep 03 03:56:11.214692 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: method: > Sep 03 03:56:11.214692 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: exception: Instance d1d08b5f-9032-4848-ba25-122cd62f1432 could not be found. Sep 03 03:56:11.214692 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: action_args: {'id': 'd1d08b5f-9032-4848-ba25-122cd62f1432'} Sep 03 03:56:11.215605 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:56:11.215605 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:11.215605 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 03:56:11.215605 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 03:56:11.215605 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 03:56:11.215605 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 03:56:11.215605 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 03:56:11.215605 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 03:56:11.215605 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 03:56:11.215605 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 03:56:11.215605 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1d08b5f-9032-4848-ba25-122cd62f1432 could not be found. Sep 03 03:56:11.215605 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:11.215605 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:11.215605 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:11.215605 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:11.215605 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:11.215605 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:11.215605 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:56:11.215605 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:56:11.215605 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:56:11.217057 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:56:11.217057 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 03:56:11.217057 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 03:56:11.217057 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 03:56:11.217057 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 03:56:11.217057 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 03:56:11.217057 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:56:11.217057 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1d08b5f-9032-4848-ba25-122cd62f1432 could not be found. Sep 03 03:56:11.217057 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:11.217057 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:11.217057 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:11.217057 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:11.217057 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:11.217057 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:11.217057 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:56:11.217057 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:56:11.217057 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1d08b5f-9032-4848-ba25-122cd62f1432 could not be found. Sep 03 03:56:11.217057 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:11.219273 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-3f3aadf3-6c38-4968-8195-b59a3d8c6515 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Returning 404 to user: Instance d1d08b5f-9032-4848-ba25-122cd62f1432 could not be found. {{(pid=132077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:56:11.220496 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-3f3aadf3-6c38-4968-8195-b59a3d8c6515 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432" status: 404 len: 111 microversion: 2.1 time: 0.040349 Sep 03 03:56:11.221156 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 479/942] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:56:11 2022] GET /compute/v2.1/servers/d1d08b5f-9032-4848-ba25-122cd62f1432 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 03:56:11.791270 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-3959667e-1272-43cb-9316-9b70a8a8153e tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:11.791863 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-3959667e-1272-43cb-9316-9b70a8a8153e tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] [instance: ed64ff03-ce00-49c3-868e-32a0be3fa6bf] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:11.798623 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3959667e-1272-43cb-9316-9b70a8a8153e tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:11.799154 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3959667e-1272-43cb-9316-9b70a8a8153e tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:11.799599 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3959667e-1272-43cb-9316-9b70a8a8153e tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:11.800295 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3959667e-1272-43cb-9316-9b70a8a8153e tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:11.800740 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3959667e-1272-43cb-9316-9b70a8a8153e tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:11.801153 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-3959667e-1272-43cb-9316-9b70a8a8153e tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:12.030268 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-3959667e-1272-43cb-9316-9b70a8a8153e tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5594b2c1a2fd4bf8ad2f1c5d2c05b777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f83c7b81a54c9a936f140ca94e3d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:12.041565 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-3959667e-1272-43cb-9316-9b70a8a8153e tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] 10.222.0.25 "GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf" status: 200 len: 1314 microversion: 2.1 time: 0.253989 Sep 03 03:56:12.042784 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 464/943] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:56:11 2022] GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:56:12.341681 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-d79c2023-9b30-4cba-9226-f00b0f198709 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:12.343115 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-d79c2023-9b30-4cba-9226-f00b0f198709 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 3d5f7818-14ce-4b6d-b040-6924c777d0d0] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:12.350163 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d79c2023-9b30-4cba-9226-f00b0f198709 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:12.350723 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d79c2023-9b30-4cba-9226-f00b0f198709 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:12.351364 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d79c2023-9b30-4cba-9226-f00b0f198709 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:12.352110 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d79c2023-9b30-4cba-9226-f00b0f198709 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:12.352558 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d79c2023-9b30-4cba-9226-f00b0f198709 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:12.352975 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d79c2023-9b30-4cba-9226-f00b0f198709 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:12.381820 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.wsgi [None req-d79c2023-9b30-4cba-9226-f00b0f198709 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] HTTP exception thrown: Instance 3d5f7818-14ce-4b6d-b040-6924c777d0d0 could not be found. Sep 03 03:56:12.383508 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-d79c2023-9b30-4cba-9226-f00b0f198709 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Request method failure captured: Sep 03 03:56:12.383508 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: request: DELETE /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0 HTTP/1.1 Sep 03 03:56:12.383508 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept: application/json Sep 03 03:56:12.383508 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept-Encoding: identity Sep 03 03:56:12.383508 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Connection: close Sep 03 03:56:12.383508 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Length: 0 Sep 03 03:56:12.383508 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Type: application/json Sep 03 03:56:12.383508 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Host: 10.222.0.25 Sep 03 03:56:12.383508 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Openstack-System-Scope: None Sep 03 03:56:12.383508 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: User-Agent: python-urllib3/1.26.12 Sep 03 03:56:12.383508 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Auth-Token: gAAAAABjEs64h6RVIvypCuKugbvW3Y7YAUFh7VDm91768lXtoPaqdzXS-_Qkyi2f6kf4lWcyQskEslSa54oS5rrkvI6NoqAIJDoRzC5rEgPQNhr4ZiyVkcp4VnwUB_Yw3zT1bWPH1f6QhT2mQz0SvBXVUEG1SgHfD7qElRNuEWp7DrnjHzS2V-s Sep 03 03:56:12.383508 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Id: None Sep 03 03:56:12.383508 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Name: None Sep 03 03:56:12.383508 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Identity-Status: Confirmed Sep 03 03:56:12.383508 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Is-Admin-Project: True Sep 03 03:56:12.383508 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Id: default Sep 03 03:56:12.383508 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Name: Default Sep 03 03:56:12.383508 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Id: 12347de4d2e5465b9a00004084fcb85c Sep 03 03:56:12.383508 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Name: tempest-AttachVolumeTestJSON-1489543824 Sep 03 03:56:12.383508 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Role: member,reader Sep 03 03:56:12.383508 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Roles: member,reader Sep 03 03:56:12.385136 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12347de4d2e5465b9a00004084fcb85c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_12347de4d2e5465b9a00004084fcb85c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/12347de4d2e5465b9a00004084fcb85c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12347de4d2e5465b9a00004084fcb85c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:56:12.385136 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant: tempest-AttachVolumeTestJSON-1489543824 Sep 03 03:56:12.385136 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Id: 12347de4d2e5465b9a00004084fcb85c Sep 03 03:56:12.385136 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1489543824 Sep 03 03:56:12.385136 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User: tempest-AttachVolumeTestJSON-1489543824-project Sep 03 03:56:12.385136 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Id: default Sep 03 03:56:12.385136 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Name: Default Sep 03 03:56:12.385136 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Id: 58361634962b4b7884d51be90b683b42 Sep 03 03:56:12.385136 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Name: tempest-AttachVolumeTestJSON-1489543824-project Sep 03 03:56:12.385136 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: method: > Sep 03 03:56:12.385136 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: exception: Instance 3d5f7818-14ce-4b6d-b040-6924c777d0d0 could not be found. Sep 03 03:56:12.385136 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: action_args: {'id': '3d5f7818-14ce-4b6d-b040-6924c777d0d0'} Sep 03 03:56:12.385942 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:56:12.385942 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:12.385942 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 03:56:12.385942 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 03:56:12.385942 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 03:56:12.385942 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 03:56:12.385942 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 03:56:12.385942 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 03:56:12.385942 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 03:56:12.385942 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 03:56:12.385942 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d5f7818-14ce-4b6d-b040-6924c777d0d0 could not be found. Sep 03 03:56:12.385942 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:12.385942 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:12.385942 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:12.385942 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:12.385942 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:12.385942 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:12.385942 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:56:12.385942 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:56:12.385942 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:56:12.387333 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:56:12.387333 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 03:56:12.387333 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 03:56:12.387333 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 03:56:12.387333 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 03:56:12.387333 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 03:56:12.387333 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 03:56:12.387333 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 03:56:12.387333 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:56:12.387333 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d5f7818-14ce-4b6d-b040-6924c777d0d0 could not be found. Sep 03 03:56:12.387333 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:12.387333 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:12.387333 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:12.387333 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:12.387333 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:12.387333 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:12.387333 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:56:12.387333 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:56:12.387333 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d5f7818-14ce-4b6d-b040-6924c777d0d0 could not be found. Sep 03 03:56:12.387333 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:12.391706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-d79c2023-9b30-4cba-9226-f00b0f198709 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Returning 404 to user: Instance 3d5f7818-14ce-4b6d-b040-6924c777d0d0 could not be found. {{(pid=132077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:56:12.393254 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-d79c2023-9b30-4cba-9226-f00b0f198709 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0" status: 404 len: 111 microversion: 2.1 time: 0.055323 Sep 03 03:56:12.401912 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 480/944] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Sep 3 03:56:12 2022] DELETE /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 03:56:12.404749 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-fc426d6e-b7eb-4925-9c5d-16bd2df4faaf tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:12.405431 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-fc426d6e-b7eb-4925-9c5d-16bd2df4faaf tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 3d5f7818-14ce-4b6d-b040-6924c777d0d0] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:12.411547 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fc426d6e-b7eb-4925-9c5d-16bd2df4faaf tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:12.412734 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fc426d6e-b7eb-4925-9c5d-16bd2df4faaf tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:12.415186 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fc426d6e-b7eb-4925-9c5d-16bd2df4faaf tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:12.415975 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fc426d6e-b7eb-4925-9c5d-16bd2df4faaf tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:12.416496 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fc426d6e-b7eb-4925-9c5d-16bd2df4faaf tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:12.416986 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fc426d6e-b7eb-4925-9c5d-16bd2df4faaf tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:12.430210 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-1c79ef1f-5abe-4082-9cf2-ee023458fef6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:12.430691 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-1c79ef1f-5abe-4082-9cf2-ee023458fef6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 8cbb99ff-b818-4de4-9dde-a3c27164f6af] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:12.448721 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.wsgi [None req-fc426d6e-b7eb-4925-9c5d-16bd2df4faaf tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] HTTP exception thrown: Instance 3d5f7818-14ce-4b6d-b040-6924c777d0d0 could not be found. Sep 03 03:56:12.449995 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-fc426d6e-b7eb-4925-9c5d-16bd2df4faaf tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Request method failure captured: Sep 03 03:56:12.449995 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: request: GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0 HTTP/1.1 Sep 03 03:56:12.449995 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept: application/json Sep 03 03:56:12.449995 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept-Encoding: identity Sep 03 03:56:12.449995 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Connection: close Sep 03 03:56:12.449995 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Length: 0 Sep 03 03:56:12.449995 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Type: application/json Sep 03 03:56:12.449995 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Host: 10.222.0.25 Sep 03 03:56:12.449995 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Openstack-System-Scope: None Sep 03 03:56:12.449995 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: User-Agent: python-urllib3/1.26.12 Sep 03 03:56:12.449995 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Auth-Token: gAAAAABjEs64h6RVIvypCuKugbvW3Y7YAUFh7VDm91768lXtoPaqdzXS-_Qkyi2f6kf4lWcyQskEslSa54oS5rrkvI6NoqAIJDoRzC5rEgPQNhr4ZiyVkcp4VnwUB_Yw3zT1bWPH1f6QhT2mQz0SvBXVUEG1SgHfD7qElRNuEWp7DrnjHzS2V-s Sep 03 03:56:12.449995 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Id: None Sep 03 03:56:12.449995 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Name: None Sep 03 03:56:12.449995 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Identity-Status: Confirmed Sep 03 03:56:12.449995 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Is-Admin-Project: True Sep 03 03:56:12.449995 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Id: default Sep 03 03:56:12.449995 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Name: Default Sep 03 03:56:12.449995 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Id: 12347de4d2e5465b9a00004084fcb85c Sep 03 03:56:12.449995 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Name: tempest-AttachVolumeTestJSON-1489543824 Sep 03 03:56:12.449995 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Role: member,reader Sep 03 03:56:12.449995 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Roles: member,reader Sep 03 03:56:12.451325 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12347de4d2e5465b9a00004084fcb85c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_12347de4d2e5465b9a00004084fcb85c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/12347de4d2e5465b9a00004084fcb85c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12347de4d2e5465b9a00004084fcb85c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:56:12.451325 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant: tempest-AttachVolumeTestJSON-1489543824 Sep 03 03:56:12.451325 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Id: 12347de4d2e5465b9a00004084fcb85c Sep 03 03:56:12.451325 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1489543824 Sep 03 03:56:12.451325 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User: tempest-AttachVolumeTestJSON-1489543824-project Sep 03 03:56:12.451325 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Id: default Sep 03 03:56:12.451325 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Name: Default Sep 03 03:56:12.451325 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Id: 58361634962b4b7884d51be90b683b42 Sep 03 03:56:12.451325 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Name: tempest-AttachVolumeTestJSON-1489543824-project Sep 03 03:56:12.451325 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: method: > Sep 03 03:56:12.451325 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: exception: Instance 3d5f7818-14ce-4b6d-b040-6924c777d0d0 could not be found. Sep 03 03:56:12.451325 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: action_args: {'id': '3d5f7818-14ce-4b6d-b040-6924c777d0d0'} Sep 03 03:56:12.452077 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:56:12.452077 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:12.452077 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 03:56:12.452077 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 03:56:12.452077 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 03:56:12.452077 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 03:56:12.452077 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 03:56:12.452077 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 03:56:12.452077 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 03:56:12.452077 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 03:56:12.452077 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d5f7818-14ce-4b6d-b040-6924c777d0d0 could not be found. Sep 03 03:56:12.452077 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:12.452077 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:12.452077 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:12.452077 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:12.452077 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:12.452077 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:12.452077 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:56:12.452077 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:56:12.452077 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:56:12.453275 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:56:12.453275 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 03:56:12.453275 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 03:56:12.453275 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 03:56:12.453275 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 03:56:12.453275 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 03:56:12.453275 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:56:12.453275 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d5f7818-14ce-4b6d-b040-6924c777d0d0 could not be found. Sep 03 03:56:12.453275 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:12.453275 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:12.453275 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:12.453275 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:12.453275 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:12.453275 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:12.453275 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:56:12.453275 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:56:12.453275 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d5f7818-14ce-4b6d-b040-6924c777d0d0 could not be found. Sep 03 03:56:12.453275 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:12.456628 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1c79ef1f-5abe-4082-9cf2-ee023458fef6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:12.457131 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1c79ef1f-5abe-4082-9cf2-ee023458fef6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:12.457543 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1c79ef1f-5abe-4082-9cf2-ee023458fef6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:12.458250 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1c79ef1f-5abe-4082-9cf2-ee023458fef6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:12.458692 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1c79ef1f-5abe-4082-9cf2-ee023458fef6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:12.459130 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-1c79ef1f-5abe-4082-9cf2-ee023458fef6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:12.463257 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-fc426d6e-b7eb-4925-9c5d-16bd2df4faaf tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Returning 404 to user: Instance 3d5f7818-14ce-4b6d-b040-6924c777d0d0 could not be found. {{(pid=132076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:56:12.464406 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-fc426d6e-b7eb-4925-9c5d-16bd2df4faaf tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0" status: 404 len: 111 microversion: 2.1 time: 0.065502 Sep 03 03:56:12.465146 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 465/945] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:56:12 2022] GET /compute/v2.1/servers/3d5f7818-14ce-4b6d-b040-6924c777d0d0 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 03:56:12.477017 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.wsgi [None req-1c79ef1f-5abe-4082-9cf2-ee023458fef6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] HTTP exception thrown: Instance 8cbb99ff-b818-4de4-9dde-a3c27164f6af could not be found. Sep 03 03:56:12.478573 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-1c79ef1f-5abe-4082-9cf2-ee023458fef6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Request method failure captured: Sep 03 03:56:12.478573 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: request: DELETE /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af HTTP/1.1 Sep 03 03:56:12.478573 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept: application/json Sep 03 03:56:12.478573 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept-Encoding: identity Sep 03 03:56:12.478573 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Connection: close Sep 03 03:56:12.478573 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Length: 0 Sep 03 03:56:12.478573 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Type: application/json Sep 03 03:56:12.478573 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Host: 10.222.0.25 Sep 03 03:56:12.478573 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Openstack-System-Scope: None Sep 03 03:56:12.478573 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: User-Agent: python-urllib3/1.26.12 Sep 03 03:56:12.478573 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Auth-Token: gAAAAABjEs650LfhdeTARTcps2T6trtQQt2m5icunzzvIWer-eUYgJYZG5Pjv6m6uWkZdMglMW7-SwnvvwA9dyIFe0GhqjthXj4rFLg5_wGV22DwN7Tu1nE8T--OP86NZDND7AUMPsZwRHed6vQjd_qeShmm1sU59yMmrfP4r0ItLtiNkEQOrd0 Sep 03 03:56:12.478573 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Id: None Sep 03 03:56:12.478573 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Name: None Sep 03 03:56:12.478573 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Identity-Status: Confirmed Sep 03 03:56:12.478573 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Is-Admin-Project: True Sep 03 03:56:12.478573 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Id: default Sep 03 03:56:12.478573 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Name: Default Sep 03 03:56:12.478573 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Id: ac9e77355ba040bda4f2186753df7b24 Sep 03 03:56:12.478573 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Name: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:56:12.478573 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Role: member,reader Sep 03 03:56:12.478573 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Roles: member,reader Sep 03 03:56:12.480017 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:56:12.480017 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:56:12.480017 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Id: ac9e77355ba040bda4f2186753df7b24 Sep 03 03:56:12.480017 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:56:12.480017 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User: tempest-AttachVolumeNegativeTest-1116033749-project Sep 03 03:56:12.480017 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Id: default Sep 03 03:56:12.480017 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Name: Default Sep 03 03:56:12.480017 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Id: 1dde7fad075145c89f726ca85c6c00ba Sep 03 03:56:12.480017 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Name: tempest-AttachVolumeNegativeTest-1116033749-project Sep 03 03:56:12.480017 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: method: > Sep 03 03:56:12.480017 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: exception: Instance 8cbb99ff-b818-4de4-9dde-a3c27164f6af could not be found. Sep 03 03:56:12.480017 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: action_args: {'id': '8cbb99ff-b818-4de4-9dde-a3c27164f6af'} Sep 03 03:56:12.481209 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:56:12.481209 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:12.481209 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 03:56:12.481209 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 03:56:12.481209 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 03:56:12.481209 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 03:56:12.481209 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 03:56:12.481209 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 03:56:12.481209 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 03:56:12.481209 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 03:56:12.481209 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cbb99ff-b818-4de4-9dde-a3c27164f6af could not be found. Sep 03 03:56:12.481209 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:12.481209 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:12.481209 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:12.481209 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:12.481209 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:12.481209 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:12.481209 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:56:12.481209 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:56:12.481209 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:56:12.483296 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:56:12.483296 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 03:56:12.483296 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 03:56:12.483296 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 03:56:12.483296 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 03:56:12.483296 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 03:56:12.483296 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 03:56:12.483296 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 03:56:12.483296 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:56:12.483296 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cbb99ff-b818-4de4-9dde-a3c27164f6af could not be found. Sep 03 03:56:12.483296 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:12.483296 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:12.483296 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:12.483296 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:12.483296 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:12.483296 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:12.483296 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:56:12.483296 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:56:12.483296 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cbb99ff-b818-4de4-9dde-a3c27164f6af could not be found. Sep 03 03:56:12.483296 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:12.486609 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-1c79ef1f-5abe-4082-9cf2-ee023458fef6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Returning 404 to user: Instance 8cbb99ff-b818-4de4-9dde-a3c27164f6af could not be found. {{(pid=132077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:56:12.486609 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-1c79ef1f-5abe-4082-9cf2-ee023458fef6 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af" status: 404 len: 111 microversion: 2.1 time: 0.053628 Sep 03 03:56:12.486609 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 481/946] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Sep 3 03:56:12 2022] DELETE /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 03:56:12.491947 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-17ee8cc7-9982-4cf6-8359-432c148de5d1 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:12.492600 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-17ee8cc7-9982-4cf6-8359-432c148de5d1 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 8cbb99ff-b818-4de4-9dde-a3c27164f6af] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:12.501331 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-17ee8cc7-9982-4cf6-8359-432c148de5d1 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:12.502070 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-17ee8cc7-9982-4cf6-8359-432c148de5d1 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:12.502782 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-17ee8cc7-9982-4cf6-8359-432c148de5d1 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:12.504007 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-17ee8cc7-9982-4cf6-8359-432c148de5d1 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:12.504832 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-17ee8cc7-9982-4cf6-8359-432c148de5d1 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:12.505541 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-17ee8cc7-9982-4cf6-8359-432c148de5d1 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:12.521083 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.wsgi [None req-17ee8cc7-9982-4cf6-8359-432c148de5d1 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] HTTP exception thrown: Instance 8cbb99ff-b818-4de4-9dde-a3c27164f6af could not be found. Sep 03 03:56:12.523204 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-17ee8cc7-9982-4cf6-8359-432c148de5d1 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Request method failure captured: Sep 03 03:56:12.523204 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: request: GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af HTTP/1.1 Sep 03 03:56:12.523204 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept: application/json Sep 03 03:56:12.523204 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept-Encoding: identity Sep 03 03:56:12.523204 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Connection: close Sep 03 03:56:12.523204 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Length: 0 Sep 03 03:56:12.523204 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Type: application/json Sep 03 03:56:12.523204 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Host: 10.222.0.25 Sep 03 03:56:12.523204 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Openstack-System-Scope: None Sep 03 03:56:12.523204 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: User-Agent: python-urllib3/1.26.12 Sep 03 03:56:12.523204 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Auth-Token: gAAAAABjEs650LfhdeTARTcps2T6trtQQt2m5icunzzvIWer-eUYgJYZG5Pjv6m6uWkZdMglMW7-SwnvvwA9dyIFe0GhqjthXj4rFLg5_wGV22DwN7Tu1nE8T--OP86NZDND7AUMPsZwRHed6vQjd_qeShmm1sU59yMmrfP4r0ItLtiNkEQOrd0 Sep 03 03:56:12.523204 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Id: None Sep 03 03:56:12.523204 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Name: None Sep 03 03:56:12.523204 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Identity-Status: Confirmed Sep 03 03:56:12.523204 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Is-Admin-Project: True Sep 03 03:56:12.523204 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Id: default Sep 03 03:56:12.523204 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Name: Default Sep 03 03:56:12.523204 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Id: ac9e77355ba040bda4f2186753df7b24 Sep 03 03:56:12.523204 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Name: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:56:12.523204 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Role: member,reader Sep 03 03:56:12.523204 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Roles: member,reader Sep 03 03:56:12.524644 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:56:12.524644 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:56:12.524644 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Id: ac9e77355ba040bda4f2186753df7b24 Sep 03 03:56:12.524644 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:56:12.524644 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User: tempest-AttachVolumeNegativeTest-1116033749-project Sep 03 03:56:12.524644 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Id: default Sep 03 03:56:12.524644 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Name: Default Sep 03 03:56:12.524644 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Id: 1dde7fad075145c89f726ca85c6c00ba Sep 03 03:56:12.524644 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Name: tempest-AttachVolumeNegativeTest-1116033749-project Sep 03 03:56:12.524644 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: method: > Sep 03 03:56:12.524644 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: exception: Instance 8cbb99ff-b818-4de4-9dde-a3c27164f6af could not be found. Sep 03 03:56:12.524644 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: action_args: {'id': '8cbb99ff-b818-4de4-9dde-a3c27164f6af'} Sep 03 03:56:12.525419 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:56:12.525419 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:12.525419 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 03:56:12.525419 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 03:56:12.525419 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 03:56:12.525419 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 03:56:12.525419 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 03:56:12.525419 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 03:56:12.525419 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 03:56:12.525419 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 03:56:12.525419 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cbb99ff-b818-4de4-9dde-a3c27164f6af could not be found. Sep 03 03:56:12.525419 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:12.525419 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:12.525419 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:12.525419 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:12.525419 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:12.525419 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:12.525419 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:56:12.525419 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:56:12.525419 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:56:12.526658 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:56:12.526658 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 03:56:12.526658 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 03:56:12.526658 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 03:56:12.526658 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 03:56:12.526658 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 03:56:12.526658 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:56:12.526658 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cbb99ff-b818-4de4-9dde-a3c27164f6af could not be found. Sep 03 03:56:12.526658 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:12.526658 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:12.526658 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:12.526658 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:12.526658 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:12.526658 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:12.526658 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:56:12.526658 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:56:12.526658 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cbb99ff-b818-4de4-9dde-a3c27164f6af could not be found. Sep 03 03:56:12.526658 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:12.528177 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-17ee8cc7-9982-4cf6-8359-432c148de5d1 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Returning 404 to user: Instance 8cbb99ff-b818-4de4-9dde-a3c27164f6af could not be found. {{(pid=132076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:56:12.528177 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-17ee8cc7-9982-4cf6-8359-432c148de5d1 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af" status: 404 len: 111 microversion: 2.1 time: 0.039712 Sep 03 03:56:12.528177 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 466/947] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:56:12 2022] GET /compute/v2.1/servers/8cbb99ff-b818-4de4-9dde-a3c27164f6af => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 03:56:12.533965 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-db4e134a-75a9-4a51-bc3d-5b041a229974 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:12.534425 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-db4e134a-75a9-4a51-bc3d-5b041a229974 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: f23f06ef-2db1-4e7b-a2f4-71927f83b40d] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:12.544300 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-db4e134a-75a9-4a51-bc3d-5b041a229974 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:12.544822 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-db4e134a-75a9-4a51-bc3d-5b041a229974 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:12.545246 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-db4e134a-75a9-4a51-bc3d-5b041a229974 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:12.546166 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-db4e134a-75a9-4a51-bc3d-5b041a229974 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:12.546778 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-db4e134a-75a9-4a51-bc3d-5b041a229974 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:12.547769 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-db4e134a-75a9-4a51-bc3d-5b041a229974 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:12.563082 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.wsgi [None req-db4e134a-75a9-4a51-bc3d-5b041a229974 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] HTTP exception thrown: Instance f23f06ef-2db1-4e7b-a2f4-71927f83b40d could not be found. Sep 03 03:56:12.564916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-db4e134a-75a9-4a51-bc3d-5b041a229974 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Request method failure captured: Sep 03 03:56:12.564916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: request: DELETE /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d HTTP/1.1 Sep 03 03:56:12.564916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept: application/json Sep 03 03:56:12.564916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept-Encoding: identity Sep 03 03:56:12.564916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Connection: close Sep 03 03:56:12.564916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Length: 0 Sep 03 03:56:12.564916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Type: application/json Sep 03 03:56:12.564916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Host: 10.222.0.25 Sep 03 03:56:12.564916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Openstack-System-Scope: None Sep 03 03:56:12.564916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: User-Agent: python-urllib3/1.26.12 Sep 03 03:56:12.564916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Auth-Token: gAAAAABjEs650LfhdeTARTcps2T6trtQQt2m5icunzzvIWer-eUYgJYZG5Pjv6m6uWkZdMglMW7-SwnvvwA9dyIFe0GhqjthXj4rFLg5_wGV22DwN7Tu1nE8T--OP86NZDND7AUMPsZwRHed6vQjd_qeShmm1sU59yMmrfP4r0ItLtiNkEQOrd0 Sep 03 03:56:12.564916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Id: None Sep 03 03:56:12.564916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Name: None Sep 03 03:56:12.564916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Identity-Status: Confirmed Sep 03 03:56:12.564916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Is-Admin-Project: True Sep 03 03:56:12.564916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Id: default Sep 03 03:56:12.564916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Name: Default Sep 03 03:56:12.564916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Id: ac9e77355ba040bda4f2186753df7b24 Sep 03 03:56:12.564916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Name: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:56:12.564916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Role: member,reader Sep 03 03:56:12.564916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Roles: member,reader Sep 03 03:56:12.566350 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:56:12.566350 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:56:12.566350 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Id: ac9e77355ba040bda4f2186753df7b24 Sep 03 03:56:12.566350 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:56:12.566350 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User: tempest-AttachVolumeNegativeTest-1116033749-project Sep 03 03:56:12.566350 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Id: default Sep 03 03:56:12.566350 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Name: Default Sep 03 03:56:12.566350 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Id: 1dde7fad075145c89f726ca85c6c00ba Sep 03 03:56:12.566350 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Name: tempest-AttachVolumeNegativeTest-1116033749-project Sep 03 03:56:12.566350 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: method: > Sep 03 03:56:12.566350 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: exception: Instance f23f06ef-2db1-4e7b-a2f4-71927f83b40d could not be found. Sep 03 03:56:12.566350 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: action_args: {'id': 'f23f06ef-2db1-4e7b-a2f4-71927f83b40d'} Sep 03 03:56:12.567356 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:56:12.567356 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:12.567356 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 03:56:12.567356 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 03:56:12.567356 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 03:56:12.567356 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 03:56:12.567356 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 03:56:12.567356 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 03:56:12.567356 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 03:56:12.567356 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 03:56:12.567356 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f23f06ef-2db1-4e7b-a2f4-71927f83b40d could not be found. Sep 03 03:56:12.567356 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:12.567356 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:12.567356 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:12.567356 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:12.567356 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:12.567356 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:12.567356 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:56:12.567356 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:56:12.567356 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:56:12.569849 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:56:12.569849 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 03:56:12.569849 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 03:56:12.569849 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 03:56:12.569849 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 03:56:12.569849 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 03:56:12.569849 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 03:56:12.569849 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 03:56:12.569849 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:56:12.569849 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f23f06ef-2db1-4e7b-a2f4-71927f83b40d could not be found. Sep 03 03:56:12.569849 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:12.569849 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:12.569849 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:12.569849 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:12.569849 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:12.569849 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:12.569849 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:56:12.569849 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:56:12.569849 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f23f06ef-2db1-4e7b-a2f4-71927f83b40d could not be found. Sep 03 03:56:12.569849 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:12.572289 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-db4e134a-75a9-4a51-bc3d-5b041a229974 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Returning 404 to user: Instance f23f06ef-2db1-4e7b-a2f4-71927f83b40d could not be found. {{(pid=132077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:56:12.572289 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-db4e134a-75a9-4a51-bc3d-5b041a229974 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d" status: 404 len: 111 microversion: 2.1 time: 0.036355 Sep 03 03:56:12.572289 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 482/948] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Sep 3 03:56:12 2022] DELETE /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 03:56:12.576673 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-095e73c1-721b-47a3-a8d7-1babd44d81b7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:12.576673 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-095e73c1-721b-47a3-a8d7-1babd44d81b7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: f23f06ef-2db1-4e7b-a2f4-71927f83b40d] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:12.582561 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-095e73c1-721b-47a3-a8d7-1babd44d81b7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:12.583216 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-095e73c1-721b-47a3-a8d7-1babd44d81b7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:12.583662 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-095e73c1-721b-47a3-a8d7-1babd44d81b7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:12.584366 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-095e73c1-721b-47a3-a8d7-1babd44d81b7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:12.585188 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-095e73c1-721b-47a3-a8d7-1babd44d81b7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:12.585323 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-095e73c1-721b-47a3-a8d7-1babd44d81b7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:12.601885 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.wsgi [None req-095e73c1-721b-47a3-a8d7-1babd44d81b7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] HTTP exception thrown: Instance f23f06ef-2db1-4e7b-a2f4-71927f83b40d could not be found. Sep 03 03:56:12.601885 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-095e73c1-721b-47a3-a8d7-1babd44d81b7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Request method failure captured: Sep 03 03:56:12.601885 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: request: GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d HTTP/1.1 Sep 03 03:56:12.601885 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept: application/json Sep 03 03:56:12.601885 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept-Encoding: identity Sep 03 03:56:12.601885 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Connection: close Sep 03 03:56:12.601885 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Length: 0 Sep 03 03:56:12.601885 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Type: application/json Sep 03 03:56:12.601885 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Host: 10.222.0.25 Sep 03 03:56:12.601885 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Openstack-System-Scope: None Sep 03 03:56:12.601885 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: User-Agent: python-urllib3/1.26.12 Sep 03 03:56:12.601885 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Auth-Token: gAAAAABjEs650LfhdeTARTcps2T6trtQQt2m5icunzzvIWer-eUYgJYZG5Pjv6m6uWkZdMglMW7-SwnvvwA9dyIFe0GhqjthXj4rFLg5_wGV22DwN7Tu1nE8T--OP86NZDND7AUMPsZwRHed6vQjd_qeShmm1sU59yMmrfP4r0ItLtiNkEQOrd0 Sep 03 03:56:12.601885 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Id: None Sep 03 03:56:12.601885 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Name: None Sep 03 03:56:12.601885 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Identity-Status: Confirmed Sep 03 03:56:12.601885 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Is-Admin-Project: True Sep 03 03:56:12.601885 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Id: default Sep 03 03:56:12.601885 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Name: Default Sep 03 03:56:12.601885 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Id: ac9e77355ba040bda4f2186753df7b24 Sep 03 03:56:12.601885 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Name: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:56:12.601885 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Role: member,reader Sep 03 03:56:12.601885 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Roles: member,reader Sep 03 03:56:12.603747 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:56:12.603747 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:56:12.603747 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Id: ac9e77355ba040bda4f2186753df7b24 Sep 03 03:56:12.603747 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:56:12.603747 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User: tempest-AttachVolumeNegativeTest-1116033749-project Sep 03 03:56:12.603747 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Id: default Sep 03 03:56:12.603747 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Name: Default Sep 03 03:56:12.603747 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Id: 1dde7fad075145c89f726ca85c6c00ba Sep 03 03:56:12.603747 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Name: tempest-AttachVolumeNegativeTest-1116033749-project Sep 03 03:56:12.603747 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: method: > Sep 03 03:56:12.603747 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: exception: Instance f23f06ef-2db1-4e7b-a2f4-71927f83b40d could not be found. Sep 03 03:56:12.603747 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: action_args: {'id': 'f23f06ef-2db1-4e7b-a2f4-71927f83b40d'} Sep 03 03:56:12.604749 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:56:12.604749 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:12.604749 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 03:56:12.604749 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 03:56:12.604749 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 03:56:12.604749 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 03:56:12.604749 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 03:56:12.604749 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 03:56:12.604749 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 03:56:12.604749 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 03:56:12.604749 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f23f06ef-2db1-4e7b-a2f4-71927f83b40d could not be found. Sep 03 03:56:12.604749 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:12.604749 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:12.604749 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:12.604749 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:12.604749 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:12.604749 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:12.604749 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:56:12.604749 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:56:12.604749 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:56:12.606618 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:56:12.606618 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 03:56:12.606618 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 03:56:12.606618 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 03:56:12.606618 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 03:56:12.606618 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 03:56:12.606618 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:56:12.606618 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f23f06ef-2db1-4e7b-a2f4-71927f83b40d could not be found. Sep 03 03:56:12.606618 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:12.606618 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:12.606618 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:12.606618 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:12.606618 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:12.606618 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:12.606618 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:56:12.606618 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:56:12.606618 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f23f06ef-2db1-4e7b-a2f4-71927f83b40d could not be found. Sep 03 03:56:12.606618 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:12.608050 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-095e73c1-721b-47a3-a8d7-1babd44d81b7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Returning 404 to user: Instance f23f06ef-2db1-4e7b-a2f4-71927f83b40d could not be found. {{(pid=132076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:56:12.608050 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-095e73c1-721b-47a3-a8d7-1babd44d81b7 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d" status: 404 len: 111 microversion: 2.1 time: 0.031421 Sep 03 03:56:12.608050 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 467/949] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:56:12 2022] GET /compute/v2.1/servers/f23f06ef-2db1-4e7b-a2f4-71927f83b40d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 03:56:13.065493 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-d1c39a4b-a6dc-4e54-bbf3-b9fa3fd48f11 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:13.066088 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-d1c39a4b-a6dc-4e54-bbf3-b9fa3fd48f11 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] [instance: ed64ff03-ce00-49c3-868e-32a0be3fa6bf] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:13.072347 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d1c39a4b-a6dc-4e54-bbf3-b9fa3fd48f11 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:13.072796 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d1c39a4b-a6dc-4e54-bbf3-b9fa3fd48f11 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:13.073482 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d1c39a4b-a6dc-4e54-bbf3-b9fa3fd48f11 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:13.074177 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d1c39a4b-a6dc-4e54-bbf3-b9fa3fd48f11 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:13.074593 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d1c39a4b-a6dc-4e54-bbf3-b9fa3fd48f11 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:13.075236 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d1c39a4b-a6dc-4e54-bbf3-b9fa3fd48f11 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:13.280146 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-d1c39a4b-a6dc-4e54-bbf3-b9fa3fd48f11 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5594b2c1a2fd4bf8ad2f1c5d2c05b777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f83c7b81a54c9a936f140ca94e3d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:13.288949 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-d1c39a4b-a6dc-4e54-bbf3-b9fa3fd48f11 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] 10.222.0.25 "GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf" status: 200 len: 1464 microversion: 2.1 time: 0.227321 Sep 03 03:56:13.289562 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 483/950] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:56:13 2022] GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf => generated 1464 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:56:13.337942 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-9232c70b-9024-4cd4-a48c-0a33198f46e2 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:13.338448 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-9232c70b-9024-4cd4-a48c-0a33198f46e2 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] [instance: ed64ff03-ce00-49c3-868e-32a0be3fa6bf] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:13.345070 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9232c70b-9024-4cd4-a48c-0a33198f46e2 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:13.345544 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9232c70b-9024-4cd4-a48c-0a33198f46e2 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:13.345965 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9232c70b-9024-4cd4-a48c-0a33198f46e2 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:13.346662 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9232c70b-9024-4cd4-a48c-0a33198f46e2 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:13.347152 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9232c70b-9024-4cd4-a48c-0a33198f46e2 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:13.347574 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-9232c70b-9024-4cd4-a48c-0a33198f46e2 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:13.373596 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-9232c70b-9024-4cd4-a48c-0a33198f46e2 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] [instance: ed64ff03-ce00-49c3-868e-32a0be3fa6bf] Going to try to terminate instance {{(pid=132076) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 03:56:13.442583 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:56:13.454734 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-9232c70b-9024-4cd4-a48c-0a33198f46e2 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf" status: 204 len: 0 microversion: 2.1 time: 0.120246 Sep 03 03:56:13.455531 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 468/951] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Sep 3 03:56:13 2022] DELETE /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 03:56:13.463912 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-54e5e6dc-1ce5-473e-ab7c-0aef23c3fb73 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:13.464498 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-54e5e6dc-1ce5-473e-ab7c-0aef23c3fb73 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] [instance: ed64ff03-ce00-49c3-868e-32a0be3fa6bf] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:13.471251 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-54e5e6dc-1ce5-473e-ab7c-0aef23c3fb73 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:13.471770 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-54e5e6dc-1ce5-473e-ab7c-0aef23c3fb73 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:13.472213 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-54e5e6dc-1ce5-473e-ab7c-0aef23c3fb73 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:13.473254 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-54e5e6dc-1ce5-473e-ab7c-0aef23c3fb73 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:13.473774 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-54e5e6dc-1ce5-473e-ab7c-0aef23c3fb73 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:13.474201 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-54e5e6dc-1ce5-473e-ab7c-0aef23c3fb73 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:13.494529 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:56:13.634312 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-54e5e6dc-1ce5-473e-ab7c-0aef23c3fb73 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5594b2c1a2fd4bf8ad2f1c5d2c05b777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f83c7b81a54c9a936f140ca94e3d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:13.642216 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-231fa003-a908-4d69-9c91-9a24aa6734b2 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:13.642837 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-231fa003-a908-4d69-9c91-9a24aa6734b2 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:13.649610 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-231fa003-a908-4d69-9c91-9a24aa6734b2 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:13.650244 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-231fa003-a908-4d69-9c91-9a24aa6734b2 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:13.650675 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-231fa003-a908-4d69-9c91-9a24aa6734b2 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:13.651407 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-231fa003-a908-4d69-9c91-9a24aa6734b2 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:13.651831 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-54e5e6dc-1ce5-473e-ab7c-0aef23c3fb73 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] 10.222.0.25 "GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf" status: 200 len: 1470 microversion: 2.1 time: 0.191743 Sep 03 03:56:13.651940 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-231fa003-a908-4d69-9c91-9a24aa6734b2 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:13.652249 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-231fa003-a908-4d69-9c91-9a24aa6734b2 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:13.652579 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 484/952] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:56:13 2022] GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf => generated 1470 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:56:13.668133 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.wsgi [None req-231fa003-a908-4d69-9c91-9a24aa6734b2 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] HTTP exception thrown: Instance 828bd786-6e99-4ccd-a4aa-9198ef8c8731 could not be found. Sep 03 03:56:13.669804 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-231fa003-a908-4d69-9c91-9a24aa6734b2 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Request method failure captured: Sep 03 03:56:13.669804 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: request: DELETE /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 HTTP/1.1 Sep 03 03:56:13.669804 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept: application/json Sep 03 03:56:13.669804 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept-Encoding: identity Sep 03 03:56:13.669804 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Connection: close Sep 03 03:56:13.669804 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Length: 0 Sep 03 03:56:13.669804 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Type: application/json Sep 03 03:56:13.669804 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Host: 10.222.0.25 Sep 03 03:56:13.669804 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Openstack-System-Scope: None Sep 03 03:56:13.669804 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: User-Agent: python-urllib3/1.26.12 Sep 03 03:56:13.669804 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Auth-Token: gAAAAABjEs64h6RVIvypCuKugbvW3Y7YAUFh7VDm91768lXtoPaqdzXS-_Qkyi2f6kf4lWcyQskEslSa54oS5rrkvI6NoqAIJDoRzC5rEgPQNhr4ZiyVkcp4VnwUB_Yw3zT1bWPH1f6QhT2mQz0SvBXVUEG1SgHfD7qElRNuEWp7DrnjHzS2V-s Sep 03 03:56:13.669804 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Id: None Sep 03 03:56:13.669804 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Name: None Sep 03 03:56:13.669804 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Identity-Status: Confirmed Sep 03 03:56:13.669804 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Is-Admin-Project: True Sep 03 03:56:13.669804 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Id: default Sep 03 03:56:13.669804 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Name: Default Sep 03 03:56:13.669804 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Id: 12347de4d2e5465b9a00004084fcb85c Sep 03 03:56:13.669804 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Name: tempest-AttachVolumeTestJSON-1489543824 Sep 03 03:56:13.669804 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Role: member,reader Sep 03 03:56:13.669804 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Roles: member,reader Sep 03 03:56:13.671469 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12347de4d2e5465b9a00004084fcb85c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_12347de4d2e5465b9a00004084fcb85c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/12347de4d2e5465b9a00004084fcb85c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12347de4d2e5465b9a00004084fcb85c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:56:13.671469 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant: tempest-AttachVolumeTestJSON-1489543824 Sep 03 03:56:13.671469 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Id: 12347de4d2e5465b9a00004084fcb85c Sep 03 03:56:13.671469 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1489543824 Sep 03 03:56:13.671469 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User: tempest-AttachVolumeTestJSON-1489543824-project Sep 03 03:56:13.671469 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Id: default Sep 03 03:56:13.671469 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Name: Default Sep 03 03:56:13.671469 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Id: 58361634962b4b7884d51be90b683b42 Sep 03 03:56:13.671469 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Name: tempest-AttachVolumeTestJSON-1489543824-project Sep 03 03:56:13.671469 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: method: > Sep 03 03:56:13.671469 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: exception: Instance 828bd786-6e99-4ccd-a4aa-9198ef8c8731 could not be found. Sep 03 03:56:13.671469 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: action_args: {'id': '828bd786-6e99-4ccd-a4aa-9198ef8c8731'} Sep 03 03:56:13.672305 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:56:13.672305 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:13.672305 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 03:56:13.672305 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 03:56:13.672305 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 03:56:13.672305 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 03:56:13.672305 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 03:56:13.672305 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 03:56:13.672305 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 03:56:13.672305 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 03:56:13.672305 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 828bd786-6e99-4ccd-a4aa-9198ef8c8731 could not be found. Sep 03 03:56:13.672305 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:13.672305 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:13.672305 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:13.672305 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:13.672305 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:13.672305 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:13.672305 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:56:13.672305 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:56:13.672305 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:56:13.673773 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:56:13.673773 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 03:56:13.673773 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 03:56:13.673773 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 03:56:13.673773 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 03:56:13.673773 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 03:56:13.673773 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 03:56:13.673773 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 03:56:13.673773 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:56:13.673773 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 828bd786-6e99-4ccd-a4aa-9198ef8c8731 could not be found. Sep 03 03:56:13.673773 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:13.673773 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:13.673773 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:13.673773 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:13.673773 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:13.673773 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:13.673773 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:56:13.673773 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:56:13.673773 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 828bd786-6e99-4ccd-a4aa-9198ef8c8731 could not be found. Sep 03 03:56:13.673773 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:13.675277 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-231fa003-a908-4d69-9c91-9a24aa6734b2 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Returning 404 to user: Instance 828bd786-6e99-4ccd-a4aa-9198ef8c8731 could not be found. {{(pid=132076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:56:13.675277 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-231fa003-a908-4d69-9c91-9a24aa6734b2 tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "DELETE /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 404 len: 111 microversion: 2.1 time: 0.033461 Sep 03 03:56:13.675277 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 469/953] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Sep 3 03:56:13 2022] DELETE /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 03:56:13.680737 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-b06cfdc4-b3c6-48f5-bf31-f92a3b45a8bb tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:13.681423 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-b06cfdc4-b3c6-48f5-bf31-f92a3b45a8bb tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] [instance: 828bd786-6e99-4ccd-a4aa-9198ef8c8731] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:13.687489 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b06cfdc4-b3c6-48f5-bf31-f92a3b45a8bb tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:13.688036 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b06cfdc4-b3c6-48f5-bf31-f92a3b45a8bb tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:13.688656 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b06cfdc4-b3c6-48f5-bf31-f92a3b45a8bb tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:13.689559 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b06cfdc4-b3c6-48f5-bf31-f92a3b45a8bb tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:13.690017 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b06cfdc4-b3c6-48f5-bf31-f92a3b45a8bb tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:13.690437 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b06cfdc4-b3c6-48f5-bf31-f92a3b45a8bb tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:13.704118 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.wsgi [None req-b06cfdc4-b3c6-48f5-bf31-f92a3b45a8bb tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] HTTP exception thrown: Instance 828bd786-6e99-4ccd-a4aa-9198ef8c8731 could not be found. Sep 03 03:56:13.705669 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-b06cfdc4-b3c6-48f5-bf31-f92a3b45a8bb tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Request method failure captured: Sep 03 03:56:13.705669 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: request: GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 HTTP/1.1 Sep 03 03:56:13.705669 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept: application/json Sep 03 03:56:13.705669 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept-Encoding: identity Sep 03 03:56:13.705669 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Connection: close Sep 03 03:56:13.705669 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Length: 0 Sep 03 03:56:13.705669 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Type: application/json Sep 03 03:56:13.705669 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Host: 10.222.0.25 Sep 03 03:56:13.705669 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Openstack-System-Scope: None Sep 03 03:56:13.705669 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: User-Agent: python-urllib3/1.26.12 Sep 03 03:56:13.705669 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Auth-Token: gAAAAABjEs64h6RVIvypCuKugbvW3Y7YAUFh7VDm91768lXtoPaqdzXS-_Qkyi2f6kf4lWcyQskEslSa54oS5rrkvI6NoqAIJDoRzC5rEgPQNhr4ZiyVkcp4VnwUB_Yw3zT1bWPH1f6QhT2mQz0SvBXVUEG1SgHfD7qElRNuEWp7DrnjHzS2V-s Sep 03 03:56:13.705669 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Id: None Sep 03 03:56:13.705669 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Name: None Sep 03 03:56:13.705669 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Identity-Status: Confirmed Sep 03 03:56:13.705669 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Is-Admin-Project: True Sep 03 03:56:13.705669 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Id: default Sep 03 03:56:13.705669 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Name: Default Sep 03 03:56:13.705669 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Id: 12347de4d2e5465b9a00004084fcb85c Sep 03 03:56:13.705669 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Name: tempest-AttachVolumeTestJSON-1489543824 Sep 03 03:56:13.705669 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Role: member,reader Sep 03 03:56:13.705669 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Roles: member,reader Sep 03 03:56:13.707569 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12347de4d2e5465b9a00004084fcb85c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_12347de4d2e5465b9a00004084fcb85c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/12347de4d2e5465b9a00004084fcb85c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/12347de4d2e5465b9a00004084fcb85c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:56:13.707569 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant: tempest-AttachVolumeTestJSON-1489543824 Sep 03 03:56:13.707569 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Id: 12347de4d2e5465b9a00004084fcb85c Sep 03 03:56:13.707569 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1489543824 Sep 03 03:56:13.707569 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User: tempest-AttachVolumeTestJSON-1489543824-project Sep 03 03:56:13.707569 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Id: default Sep 03 03:56:13.707569 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Name: Default Sep 03 03:56:13.707569 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Id: 58361634962b4b7884d51be90b683b42 Sep 03 03:56:13.707569 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Name: tempest-AttachVolumeTestJSON-1489543824-project Sep 03 03:56:13.707569 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: method: > Sep 03 03:56:13.707569 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: exception: Instance 828bd786-6e99-4ccd-a4aa-9198ef8c8731 could not be found. Sep 03 03:56:13.707569 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: action_args: {'id': '828bd786-6e99-4ccd-a4aa-9198ef8c8731'} Sep 03 03:56:13.708465 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:56:13.708465 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:13.708465 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 03:56:13.708465 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 03:56:13.708465 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 03:56:13.708465 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 03:56:13.708465 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 03:56:13.708465 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 03:56:13.708465 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 03:56:13.708465 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 03:56:13.708465 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 828bd786-6e99-4ccd-a4aa-9198ef8c8731 could not be found. Sep 03 03:56:13.708465 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:13.708465 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:13.708465 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:13.708465 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:13.708465 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:13.708465 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:13.708465 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:56:13.708465 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:56:13.708465 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:56:13.709917 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:56:13.709917 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 03:56:13.709917 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 03:56:13.709917 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 03:56:13.709917 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 03:56:13.709917 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 03:56:13.709917 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:56:13.709917 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 828bd786-6e99-4ccd-a4aa-9198ef8c8731 could not be found. Sep 03 03:56:13.709917 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:13.709917 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:13.709917 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:13.709917 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:13.709917 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:13.709917 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:13.709917 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:56:13.709917 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:56:13.709917 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 828bd786-6e99-4ccd-a4aa-9198ef8c8731 could not be found. Sep 03 03:56:13.709917 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:13.711445 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-b06cfdc4-b3c6-48f5-bf31-f92a3b45a8bb tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] Returning 404 to user: Instance 828bd786-6e99-4ccd-a4aa-9198ef8c8731 could not be found. {{(pid=132077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:56:13.711445 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-b06cfdc4-b3c6-48f5-bf31-f92a3b45a8bb tempest-AttachVolumeTestJSON-1489543824 tempest-AttachVolumeTestJSON-1489543824-project] 10.222.0.25 "GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731" status: 404 len: 111 microversion: 2.1 time: 0.030418 Sep 03 03:56:13.711445 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 485/954] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:56:13 2022] GET /compute/v2.1/servers/828bd786-6e99-4ccd-a4aa-9198ef8c8731 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 03:56:13.772120 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-c84eac8e-232a-482b-b1e2-0571a98473a3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:13.772709 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-c84eac8e-232a-482b-b1e2-0571a98473a3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:13.778895 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c84eac8e-232a-482b-b1e2-0571a98473a3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:13.779381 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c84eac8e-232a-482b-b1e2-0571a98473a3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:13.779804 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c84eac8e-232a-482b-b1e2-0571a98473a3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:13.780496 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c84eac8e-232a-482b-b1e2-0571a98473a3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:13.780936 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c84eac8e-232a-482b-b1e2-0571a98473a3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:13.781353 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c84eac8e-232a-482b-b1e2-0571a98473a3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:13.797058 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.wsgi [None req-c84eac8e-232a-482b-b1e2-0571a98473a3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] HTTP exception thrown: Instance 69fe618d-1192-4541-9d90-e5cee06be911 could not be found. Sep 03 03:56:13.798944 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-c84eac8e-232a-482b-b1e2-0571a98473a3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Request method failure captured: Sep 03 03:56:13.798944 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: request: DELETE /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 HTTP/1.1 Sep 03 03:56:13.798944 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept: application/json Sep 03 03:56:13.798944 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept-Encoding: identity Sep 03 03:56:13.798944 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Connection: close Sep 03 03:56:13.798944 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Length: 0 Sep 03 03:56:13.798944 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Type: application/json Sep 03 03:56:13.798944 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Host: 10.222.0.25 Sep 03 03:56:13.798944 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Openstack-System-Scope: None Sep 03 03:56:13.798944 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: User-Agent: python-urllib3/1.26.12 Sep 03 03:56:13.798944 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Auth-Token: gAAAAABjEs650LfhdeTARTcps2T6trtQQt2m5icunzzvIWer-eUYgJYZG5Pjv6m6uWkZdMglMW7-SwnvvwA9dyIFe0GhqjthXj4rFLg5_wGV22DwN7Tu1nE8T--OP86NZDND7AUMPsZwRHed6vQjd_qeShmm1sU59yMmrfP4r0ItLtiNkEQOrd0 Sep 03 03:56:13.798944 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Id: None Sep 03 03:56:13.798944 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Name: None Sep 03 03:56:13.798944 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Identity-Status: Confirmed Sep 03 03:56:13.798944 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Is-Admin-Project: True Sep 03 03:56:13.798944 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Id: default Sep 03 03:56:13.798944 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Name: Default Sep 03 03:56:13.798944 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Id: ac9e77355ba040bda4f2186753df7b24 Sep 03 03:56:13.798944 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Name: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:56:13.798944 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Role: member,reader Sep 03 03:56:13.798944 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Roles: member,reader Sep 03 03:56:13.800527 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:56:13.800527 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:56:13.800527 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Id: ac9e77355ba040bda4f2186753df7b24 Sep 03 03:56:13.800527 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:56:13.800527 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User: tempest-AttachVolumeNegativeTest-1116033749-project Sep 03 03:56:13.800527 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Id: default Sep 03 03:56:13.800527 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Name: Default Sep 03 03:56:13.800527 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Id: 1dde7fad075145c89f726ca85c6c00ba Sep 03 03:56:13.800527 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Name: tempest-AttachVolumeNegativeTest-1116033749-project Sep 03 03:56:13.800527 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: method: > Sep 03 03:56:13.800527 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: exception: Instance 69fe618d-1192-4541-9d90-e5cee06be911 could not be found. Sep 03 03:56:13.800527 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: action_args: {'id': '69fe618d-1192-4541-9d90-e5cee06be911'} Sep 03 03:56:13.801440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:56:13.801440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:13.801440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 03:56:13.801440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 03:56:13.801440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 03:56:13.801440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 03:56:13.801440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 03:56:13.801440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 03:56:13.801440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 03:56:13.801440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 03:56:13.801440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69fe618d-1192-4541-9d90-e5cee06be911 could not be found. Sep 03 03:56:13.801440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:13.801440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:13.801440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:13.801440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:13.801440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:13.801440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:13.801440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:56:13.801440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:56:13.801440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:56:13.802932 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:56:13.802932 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 03:56:13.802932 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 03:56:13.802932 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 03:56:13.802932 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 03:56:13.802932 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 03:56:13.802932 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 03:56:13.802932 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 03:56:13.802932 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:56:13.802932 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69fe618d-1192-4541-9d90-e5cee06be911 could not be found. Sep 03 03:56:13.802932 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:13.802932 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:13.802932 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:13.802932 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:13.802932 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:13.802932 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:13.802932 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:56:13.802932 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:56:13.802932 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69fe618d-1192-4541-9d90-e5cee06be911 could not be found. Sep 03 03:56:13.802932 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:13.805036 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-c84eac8e-232a-482b-b1e2-0571a98473a3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Returning 404 to user: Instance 69fe618d-1192-4541-9d90-e5cee06be911 could not be found. {{(pid=132076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:56:13.806023 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-c84eac8e-232a-482b-b1e2-0571a98473a3 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "DELETE /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911" status: 404 len: 111 microversion: 2.1 time: 0.044820 Sep 03 03:56:13.810050 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 470/955] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Sep 3 03:56:13 2022] DELETE /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 03:56:13.814972 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-17ef67c1-b78a-4a22-922d-8132a3468870 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:13.815575 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-17ef67c1-b78a-4a22-922d-8132a3468870 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] [instance: 69fe618d-1192-4541-9d90-e5cee06be911] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:13.840104 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-17ef67c1-b78a-4a22-922d-8132a3468870 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:13.840608 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-17ef67c1-b78a-4a22-922d-8132a3468870 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:13.841038 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-17ef67c1-b78a-4a22-922d-8132a3468870 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:13.841748 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-17ef67c1-b78a-4a22-922d-8132a3468870 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:13.842199 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-17ef67c1-b78a-4a22-922d-8132a3468870 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:13.842615 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-17ef67c1-b78a-4a22-922d-8132a3468870 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:13.857334 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.wsgi [None req-17ef67c1-b78a-4a22-922d-8132a3468870 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] HTTP exception thrown: Instance 69fe618d-1192-4541-9d90-e5cee06be911 could not be found. Sep 03 03:56:13.858916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-17ef67c1-b78a-4a22-922d-8132a3468870 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Request method failure captured: Sep 03 03:56:13.858916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: request: GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 HTTP/1.1 Sep 03 03:56:13.858916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept: application/json Sep 03 03:56:13.858916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept-Encoding: identity Sep 03 03:56:13.858916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Connection: close Sep 03 03:56:13.858916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Length: 0 Sep 03 03:56:13.858916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Type: application/json Sep 03 03:56:13.858916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Host: 10.222.0.25 Sep 03 03:56:13.858916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Openstack-System-Scope: None Sep 03 03:56:13.858916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: User-Agent: python-urllib3/1.26.12 Sep 03 03:56:13.858916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Auth-Token: gAAAAABjEs650LfhdeTARTcps2T6trtQQt2m5icunzzvIWer-eUYgJYZG5Pjv6m6uWkZdMglMW7-SwnvvwA9dyIFe0GhqjthXj4rFLg5_wGV22DwN7Tu1nE8T--OP86NZDND7AUMPsZwRHed6vQjd_qeShmm1sU59yMmrfP4r0ItLtiNkEQOrd0 Sep 03 03:56:13.858916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Id: None Sep 03 03:56:13.858916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Name: None Sep 03 03:56:13.858916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Identity-Status: Confirmed Sep 03 03:56:13.858916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Is-Admin-Project: True Sep 03 03:56:13.858916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Id: default Sep 03 03:56:13.858916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Name: Default Sep 03 03:56:13.858916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Id: ac9e77355ba040bda4f2186753df7b24 Sep 03 03:56:13.858916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Name: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:56:13.858916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Role: member,reader Sep 03 03:56:13.858916 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Roles: member,reader Sep 03 03:56:13.860545 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac9e77355ba040bda4f2186753df7b24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:56:13.860545 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:56:13.860545 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Id: ac9e77355ba040bda4f2186753df7b24 Sep 03 03:56:13.860545 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1116033749 Sep 03 03:56:13.860545 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User: tempest-AttachVolumeNegativeTest-1116033749-project Sep 03 03:56:13.860545 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Id: default Sep 03 03:56:13.860545 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Name: Default Sep 03 03:56:13.860545 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Id: 1dde7fad075145c89f726ca85c6c00ba Sep 03 03:56:13.860545 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Name: tempest-AttachVolumeNegativeTest-1116033749-project Sep 03 03:56:13.860545 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: method: > Sep 03 03:56:13.860545 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: exception: Instance 69fe618d-1192-4541-9d90-e5cee06be911 could not be found. Sep 03 03:56:13.860545 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: action_args: {'id': '69fe618d-1192-4541-9d90-e5cee06be911'} Sep 03 03:56:13.861354 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:56:13.861354 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:13.861354 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 03:56:13.861354 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 03:56:13.861354 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 03:56:13.861354 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 03:56:13.861354 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 03:56:13.861354 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 03:56:13.861354 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 03:56:13.861354 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 03:56:13.861354 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69fe618d-1192-4541-9d90-e5cee06be911 could not be found. Sep 03 03:56:13.861354 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:13.861354 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:13.861354 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:13.861354 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:13.861354 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:13.861354 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:13.861354 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:56:13.861354 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:56:13.861354 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:56:13.862550 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:56:13.862550 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 03:56:13.862550 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 03:56:13.862550 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 03:56:13.862550 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 03:56:13.862550 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 03:56:13.862550 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:56:13.862550 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69fe618d-1192-4541-9d90-e5cee06be911 could not be found. Sep 03 03:56:13.862550 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:13.862550 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:13.862550 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:13.862550 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:13.862550 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:13.862550 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:13.862550 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:56:13.862550 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:56:13.862550 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69fe618d-1192-4541-9d90-e5cee06be911 could not be found. Sep 03 03:56:13.862550 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:13.863643 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-17ef67c1-b78a-4a22-922d-8132a3468870 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] Returning 404 to user: Instance 69fe618d-1192-4541-9d90-e5cee06be911 could not be found. {{(pid=132077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:56:13.863643 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-17ef67c1-b78a-4a22-922d-8132a3468870 tempest-AttachVolumeNegativeTest-1116033749 tempest-AttachVolumeNegativeTest-1116033749-project] 10.222.0.25 "GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911" status: 404 len: 111 microversion: 2.1 time: 0.049303 Sep 03 03:56:13.863643 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 486/956] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:56:13 2022] GET /compute/v2.1/servers/69fe618d-1192-4541-9d90-e5cee06be911 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 03:56:14.678241 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-4e052edb-1427-4a9d-85d2-2de95448a223 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:14.678241 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-4e052edb-1427-4a9d-85d2-2de95448a223 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] [instance: ed64ff03-ce00-49c3-868e-32a0be3fa6bf] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:14.683763 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4e052edb-1427-4a9d-85d2-2de95448a223 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:14.684350 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4e052edb-1427-4a9d-85d2-2de95448a223 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:14.685004 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4e052edb-1427-4a9d-85d2-2de95448a223 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:14.685716 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4e052edb-1427-4a9d-85d2-2de95448a223 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:14.686157 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4e052edb-1427-4a9d-85d2-2de95448a223 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:14.686595 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-4e052edb-1427-4a9d-85d2-2de95448a223 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:14.883214 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-4e052edb-1427-4a9d-85d2-2de95448a223 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5594b2c1a2fd4bf8ad2f1c5d2c05b777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f83c7b81a54c9a936f140ca94e3d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:14.894890 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-4e052edb-1427-4a9d-85d2-2de95448a223 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] 10.222.0.25 "GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf" status: 200 len: 1470 microversion: 2.1 time: 0.222899 Sep 03 03:56:14.895790 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 471/957] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:56:14 2022] GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf => generated 1470 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:56:15.919083 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-d1ee460f-72e2-45b8-8d9b-af767c1df8c9 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:15.920335 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-d1ee460f-72e2-45b8-8d9b-af767c1df8c9 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] [instance: ed64ff03-ce00-49c3-868e-32a0be3fa6bf] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:15.924608 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:56:15.930588 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d1ee460f-72e2-45b8-8d9b-af767c1df8c9 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:15.931117 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d1ee460f-72e2-45b8-8d9b-af767c1df8c9 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:15.931556 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d1ee460f-72e2-45b8-8d9b-af767c1df8c9 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:15.932272 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d1ee460f-72e2-45b8-8d9b-af767c1df8c9 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:15.932727 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d1ee460f-72e2-45b8-8d9b-af767c1df8c9 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:15.933157 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d1ee460f-72e2-45b8-8d9b-af767c1df8c9 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:16.034481 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-fb07c34e-fe7b-4f31-930c-c3fcde47ebcb req-08192343-86dd-42e7-b018-e919841a3ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed64ff03-ce00-49c3-868e-32a0be3fa6bf", "name": "network-vif-deleted", "tag": "82c62b2e-5cba-4fe3-a25f-2938d6b39233"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:56:16.077236 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-fb07c34e-fe7b-4f31-930c-c3fcde47ebcb req-08192343-86dd-42e7-b018-e919841a3ba8 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:16.077728 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-fb07c34e-fe7b-4f31-930c-c3fcde47ebcb req-08192343-86dd-42e7-b018-e919841a3ba8 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:16.078780 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-fb07c34e-fe7b-4f31-930c-c3fcde47ebcb req-08192343-86dd-42e7-b018-e919841a3ba8 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:16.087213 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-d1ee460f-72e2-45b8-8d9b-af767c1df8c9 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5594b2c1a2fd4bf8ad2f1c5d2c05b777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f83c7b81a54c9a936f140ca94e3d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:56:16.100911 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-fb07c34e-fe7b-4f31-930c-c3fcde47ebcb req-08192343-86dd-42e7-b018-e919841a3ba8 service nova] Creating event network-vif-deleted:82c62b2e-5cba-4fe3-a25f-2938d6b39233 for instance ed64ff03-ce00-49c3-868e-32a0be3fa6bf on hv-cinder-79966 Sep 03 03:56:16.101559 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-d1ee460f-72e2-45b8-8d9b-af767c1df8c9 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] 10.222.0.25 "GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf" status: 200 len: 1428 microversion: 2.1 time: 0.187469 Sep 03 03:56:16.102180 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 487/958] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:56:15 2022] GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf => generated 1428 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:56:16.123941 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-fb07c34e-fe7b-4f31-930c-c3fcde47ebcb req-08192343-86dd-42e7-b018-e919841a3ba8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099046 Sep 03 03:56:16.125119 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 472/959] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:56:17.131088 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-6cf1e49f-b8b7-47f4-a825-72fd409fed95 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:17.131667 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-6cf1e49f-b8b7-47f4-a825-72fd409fed95 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] [instance: ed64ff03-ce00-49c3-868e-32a0be3fa6bf] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:56:17.138461 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6cf1e49f-b8b7-47f4-a825-72fd409fed95 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:17.139028 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6cf1e49f-b8b7-47f4-a825-72fd409fed95 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:17.139459 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6cf1e49f-b8b7-47f4-a825-72fd409fed95 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:17.140168 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6cf1e49f-b8b7-47f4-a825-72fd409fed95 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:56:17.140624 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6cf1e49f-b8b7-47f4-a825-72fd409fed95 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:56:17.141046 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-6cf1e49f-b8b7-47f4-a825-72fd409fed95 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:56:17.155644 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.wsgi [None req-6cf1e49f-b8b7-47f4-a825-72fd409fed95 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] HTTP exception thrown: Instance ed64ff03-ce00-49c3-868e-32a0be3fa6bf could not be found. Sep 03 03:56:17.157349 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-6cf1e49f-b8b7-47f4-a825-72fd409fed95 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Request method failure captured: Sep 03 03:56:17.157349 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: request: GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf HTTP/1.1 Sep 03 03:56:17.157349 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept: application/json Sep 03 03:56:17.157349 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept-Encoding: identity Sep 03 03:56:17.157349 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Connection: close Sep 03 03:56:17.157349 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Length: 0 Sep 03 03:56:17.157349 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Type: application/json Sep 03 03:56:17.157349 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Host: 10.222.0.25 Sep 03 03:56:17.157349 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Openstack-System-Scope: None Sep 03 03:56:17.157349 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: User-Agent: python-urllib3/1.26.12 Sep 03 03:56:17.157349 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Auth-Token: gAAAAABjEtBFaNF7RaRAXo-N_7iNEEbyzBm3m83tQmogyhoLBr_zdwDGfGf02XrI6K4NYrxr34b22RaM4Q8YFZ5UbOkdruPDlWFdnFSgembenLtqg4ABwO36giQN9ijzcQPMTvp2eTYDxCwzRCpoF7BNoqoVnHQ7Kw4RjLwZCDhfXBrrJ8FlYNM Sep 03 03:56:17.157349 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Id: None Sep 03 03:56:17.157349 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Name: None Sep 03 03:56:17.157349 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Identity-Status: Confirmed Sep 03 03:56:17.157349 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Is-Admin-Project: True Sep 03 03:56:17.157349 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Id: default Sep 03 03:56:17.157349 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Name: Default Sep 03 03:56:17.157349 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Id: 78f83c7b81a54c9a936f140ca94e3d34 Sep 03 03:56:17.157349 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Name: tempest-VolumesNegativeTest-1418784912 Sep 03 03:56:17.157349 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Role: member,reader Sep 03 03:56:17.157349 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Roles: member,reader Sep 03 03:56:17.159041 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78f83c7b81a54c9a936f140ca94e3d34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_78f83c7b81a54c9a936f140ca94e3d34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/78f83c7b81a54c9a936f140ca94e3d34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78f83c7b81a54c9a936f140ca94e3d34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:56:17.159041 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant: tempest-VolumesNegativeTest-1418784912 Sep 03 03:56:17.159041 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Id: 78f83c7b81a54c9a936f140ca94e3d34 Sep 03 03:56:17.159041 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Name: tempest-VolumesNegativeTest-1418784912 Sep 03 03:56:17.159041 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User: tempest-VolumesNegativeTest-1418784912-project Sep 03 03:56:17.159041 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Id: default Sep 03 03:56:17.159041 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Name: Default Sep 03 03:56:17.159041 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Id: 5594b2c1a2fd4bf8ad2f1c5d2c05b777 Sep 03 03:56:17.159041 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Name: tempest-VolumesNegativeTest-1418784912-project Sep 03 03:56:17.159041 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: method: > Sep 03 03:56:17.159041 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: exception: Instance ed64ff03-ce00-49c3-868e-32a0be3fa6bf could not be found. Sep 03 03:56:17.159041 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: action_args: {'id': 'ed64ff03-ce00-49c3-868e-32a0be3fa6bf'} Sep 03 03:56:17.160173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:56:17.160173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:17.160173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 03:56:17.160173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 03:56:17.160173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 03:56:17.160173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 03:56:17.160173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 03:56:17.160173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 03:56:17.160173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 03:56:17.160173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 03:56:17.160173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed64ff03-ce00-49c3-868e-32a0be3fa6bf could not be found. Sep 03 03:56:17.160173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:17.160173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:17.160173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:17.160173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:17.160173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:17.160173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:17.160173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:56:17.160173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:56:17.160173 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:56:17.161772 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:56:17.161772 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 03:56:17.161772 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 03:56:17.161772 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 03:56:17.161772 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 03:56:17.161772 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 03:56:17.161772 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:56:17.161772 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed64ff03-ce00-49c3-868e-32a0be3fa6bf could not be found. Sep 03 03:56:17.161772 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:17.161772 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:17.161772 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:17.161772 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:17.161772 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:17.161772 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:17.161772 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:56:17.161772 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:56:17.161772 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed64ff03-ce00-49c3-868e-32a0be3fa6bf could not be found. Sep 03 03:56:17.161772 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:17.163072 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-6cf1e49f-b8b7-47f4-a825-72fd409fed95 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] Returning 404 to user: Instance ed64ff03-ce00-49c3-868e-32a0be3fa6bf could not be found. {{(pid=132077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:56:17.163072 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-6cf1e49f-b8b7-47f4-a825-72fd409fed95 tempest-VolumesNegativeTest-1418784912 tempest-VolumesNegativeTest-1418784912-project] 10.222.0.25 "GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf" status: 404 len: 111 microversion: 2.1 time: 0.032866 Sep 03 03:56:17.164420 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 488/960] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:56:17 2022] GET /compute/v2.1/servers/ed64ff03-ce00-49c3-868e-32a0be3fa6bf => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 03:56:21.842473 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-856a1990-ad3f-46d1-96dd-b9468f6b5664 tempest-VolumesNegativeTest-1596523036 tempest-VolumesNegativeTest-1596523036-project] Action: 'create', calling method: .version_select at 0x7f45fff05f70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-751625187", "metadata": {"Type": "work"}}} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:56:21.856915 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-856a1990-ad3f-46d1-96dd-b9468f6b5664 tempest-VolumesNegativeTest-1596523036 tempest-VolumesNegativeTest-1596523036-project] Request method failure captured: Sep 03 03:56:21.856915 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 03 03:56:21.856915 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept: application/json Sep 03 03:56:21.856915 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept-Encoding: identity Sep 03 03:56:21.856915 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Connection: close Sep 03 03:56:21.856915 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Length: 121 Sep 03 03:56:21.856915 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Type: application/json Sep 03 03:56:21.856915 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Host: 10.222.0.25 Sep 03 03:56:21.856915 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Openstack-System-Scope: None Sep 03 03:56:21.856915 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: User-Agent: python-urllib3/1.26.12 Sep 03 03:56:21.856915 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Auth-Token: gAAAAABjEtBllYkaiX2PFGAgBX0qSPJz2ZxL_kP1Nl5FUiakngOdRQxb5h2BbpWjnokpENJV0wmx4GBwtk0zPtQfeK7iwHCzZeo8RKlSY4bf5fY7qC_ija9gEbMk0TYDFH_1SSlnOcvVtMY10UxJS8teN-Wb26XgnHhnp-38ad1rLOx0kutXly0 Sep 03 03:56:21.856915 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Id: None Sep 03 03:56:21.856915 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Name: None Sep 03 03:56:21.856915 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Identity-Status: Confirmed Sep 03 03:56:21.856915 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Is-Admin-Project: True Sep 03 03:56:21.856915 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Id: default Sep 03 03:56:21.856915 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Name: Default Sep 03 03:56:21.856915 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Id: 0c500af6dea04db19c4d6e864220c5dd Sep 03 03:56:21.856915 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Name: tempest-VolumesNegativeTest-1596523036 Sep 03 03:56:21.856915 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Role: member,reader Sep 03 03:56:21.856915 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Roles: member,reader Sep 03 03:56:21.859432 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c500af6dea04db19c4d6e864220c5dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0c500af6dea04db19c4d6e864220c5dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0c500af6dea04db19c4d6e864220c5dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c500af6dea04db19c4d6e864220c5dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:56:21.859432 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant: tempest-VolumesNegativeTest-1596523036 Sep 03 03:56:21.859432 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Id: 0c500af6dea04db19c4d6e864220c5dd Sep 03 03:56:21.859432 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Name: tempest-VolumesNegativeTest-1596523036 Sep 03 03:56:21.859432 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User: tempest-VolumesNegativeTest-1596523036-project Sep 03 03:56:21.859432 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Id: default Sep 03 03:56:21.859432 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Name: Default Sep 03 03:56:21.859432 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Id: 3ab0e446f4a146ceb3b80e8cfa676b41 Sep 03 03:56:21.859432 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Name: tempest-VolumesNegativeTest-1596523036-project Sep 03 03:56:21.859432 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Sep 03 03:56:21.859432 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-751625187", "metadata": {"Type": "work"}}} Sep 03 03:56:21.859432 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: method: Sep 03 03:56:21.859432 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 03 03:56:21.860935 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-751625187', 'metadata': {'Type': 'work'}}}} Sep 03 03:56:21.860935 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:56:21.860935 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:21.860935 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 03:56:21.860935 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 03:56:21.860935 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 03:56:21.860935 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise error Sep 03 03:56:21.860935 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 03 03:56:21.860935 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:21.860935 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 03 03:56:21.860935 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 03 03:56:21.860935 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:21.860935 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 03 03:56:21.860935 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi '#$%' Sep 03 03:56:21.860935 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:21.860935 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:21.860935 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:21.860935 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:21.860935 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:21.860935 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:21.860935 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:56:21.860935 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:56:21.863099 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 03:56:21.863099 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 03:56:21.863099 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:56:21.863099 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:56:21.863099 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 03:56:21.863099 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 03:56:21.863099 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 03:56:21.863099 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 03:56:21.863099 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 03:56:21.863099 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 03:56:21.863099 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 03 03:56:21.863099 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:21.863099 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:21.863099 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:21.863099 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:21.863099 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:21.863099 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:21.863099 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 03:56:21.863099 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 03:56:21.864459 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 03 03:56:21.864459 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:21.864459 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-856a1990-ad3f-46d1-96dd-b9468f6b5664 tempest-VolumesNegativeTest-1596523036 tempest-VolumesNegativeTest-1596523036-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=132076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:56:21.864459 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-856a1990-ad3f-46d1-96dd-b9468f6b5664 tempest-VolumesNegativeTest-1596523036 tempest-VolumesNegativeTest-1596523036-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.145175 Sep 03 03:56:21.864459 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 473/961] 10.222.0.25 () {60 vars in 1156 bytes} [Sat Sep 3 03:56:21 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 146 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 03 03:56:21.869867 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-e5c744f7-f754-4994-9092-41478d1555bb tempest-VolumesNegativeTest-1596523036 tempest-VolumesNegativeTest-1596523036-project] Action: 'create', calling method: .version_select at 0x7f45fc58c3a0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-188560820", "metadata": {"Type": "work"}}} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:56:21.874685 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-e5c744f7-f754-4994-9092-41478d1555bb tempest-VolumesNegativeTest-1596523036 tempest-VolumesNegativeTest-1596523036-project] Request method failure captured: Sep 03 03:56:21.874685 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 03 03:56:21.874685 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept: application/json Sep 03 03:56:21.874685 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept-Encoding: identity Sep 03 03:56:21.874685 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Connection: close Sep 03 03:56:21.874685 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Length: 119 Sep 03 03:56:21.874685 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Type: application/json Sep 03 03:56:21.874685 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Host: 10.222.0.25 Sep 03 03:56:21.874685 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Openstack-System-Scope: None Sep 03 03:56:21.874685 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: User-Agent: python-urllib3/1.26.12 Sep 03 03:56:21.874685 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Auth-Token: gAAAAABjEtBllYkaiX2PFGAgBX0qSPJz2ZxL_kP1Nl5FUiakngOdRQxb5h2BbpWjnokpENJV0wmx4GBwtk0zPtQfeK7iwHCzZeo8RKlSY4bf5fY7qC_ija9gEbMk0TYDFH_1SSlnOcvVtMY10UxJS8teN-Wb26XgnHhnp-38ad1rLOx0kutXly0 Sep 03 03:56:21.874685 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Id: None Sep 03 03:56:21.874685 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Name: None Sep 03 03:56:21.874685 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Identity-Status: Confirmed Sep 03 03:56:21.874685 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Is-Admin-Project: True Sep 03 03:56:21.874685 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Id: default Sep 03 03:56:21.874685 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Name: Default Sep 03 03:56:21.874685 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Id: 0c500af6dea04db19c4d6e864220c5dd Sep 03 03:56:21.874685 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Name: tempest-VolumesNegativeTest-1596523036 Sep 03 03:56:21.874685 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Role: member,reader Sep 03 03:56:21.874685 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Roles: member,reader Sep 03 03:56:21.876362 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c500af6dea04db19c4d6e864220c5dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0c500af6dea04db19c4d6e864220c5dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0c500af6dea04db19c4d6e864220c5dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c500af6dea04db19c4d6e864220c5dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:56:21.876362 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant: tempest-VolumesNegativeTest-1596523036 Sep 03 03:56:21.876362 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Id: 0c500af6dea04db19c4d6e864220c5dd Sep 03 03:56:21.876362 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Name: tempest-VolumesNegativeTest-1596523036 Sep 03 03:56:21.876362 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User: tempest-VolumesNegativeTest-1596523036-project Sep 03 03:56:21.876362 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Id: default Sep 03 03:56:21.876362 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Name: Default Sep 03 03:56:21.876362 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Id: 3ab0e446f4a146ceb3b80e8cfa676b41 Sep 03 03:56:21.876362 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Name: tempest-VolumesNegativeTest-1596523036-project Sep 03 03:56:21.876362 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Sep 03 03:56:21.876362 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-188560820", "metadata": {"Type": "work"}}} Sep 03 03:56:21.876362 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: method: Sep 03 03:56:21.876362 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 03 03:56:21.877256 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-188560820', 'metadata': {'Type': 'work'}}}} Sep 03 03:56:21.877256 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:56:21.877256 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:21.877256 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 03:56:21.877256 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 03:56:21.877256 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 03:56:21.877256 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise error Sep 03 03:56:21.877256 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 03 03:56:21.877256 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:21.877256 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 03 03:56:21.877256 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 03 03:56:21.877256 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:21.877256 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 03 03:56:21.877256 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi '0' Sep 03 03:56:21.877256 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:21.877256 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:21.877256 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:21.877256 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:21.877256 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:21.877256 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:21.877256 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:56:21.877256 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:56:21.879208 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 03:56:21.879208 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 03:56:21.879208 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:56:21.879208 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:56:21.879208 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 03:56:21.879208 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 03:56:21.879208 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 03:56:21.879208 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 03:56:21.879208 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 03:56:21.879208 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 03:56:21.879208 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 03 03:56:21.879208 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:21.879208 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:21.879208 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:21.879208 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:21.879208 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:21.879208 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:21.879208 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 03:56:21.879208 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 03:56:21.880505 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 03 03:56:21.880505 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:21.880505 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-e5c744f7-f754-4994-9092-41478d1555bb tempest-VolumesNegativeTest-1596523036 tempest-VolumesNegativeTest-1596523036-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=132077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:56:21.880505 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-e5c744f7-f754-4994-9092-41478d1555bb tempest-VolumesNegativeTest-1596523036 tempest-VolumesNegativeTest-1596523036-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010433 Sep 03 03:56:21.880505 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 489/962] 10.222.0.25 () {60 vars in 1156 bytes} [Sat Sep 3 03:56:21 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 03:56:21.887111 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-d4ee55f0-8f43-404c-a75f-b2dae1de3791 tempest-VolumesNegativeTest-1596523036 tempest-VolumesNegativeTest-1596523036-project] Action: 'create', calling method: .version_select at 0x7f45fc4f8670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-403320799", "metadata": {"Type": "work"}}} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:56:21.890893 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-d4ee55f0-8f43-404c-a75f-b2dae1de3791 tempest-VolumesNegativeTest-1596523036 tempest-VolumesNegativeTest-1596523036-project] Request method failure captured: Sep 03 03:56:21.890893 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 03 03:56:21.890893 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept: application/json Sep 03 03:56:21.890893 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept-Encoding: identity Sep 03 03:56:21.890893 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Connection: close Sep 03 03:56:21.890893 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Length: 118 Sep 03 03:56:21.890893 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Type: application/json Sep 03 03:56:21.890893 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Host: 10.222.0.25 Sep 03 03:56:21.890893 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Openstack-System-Scope: None Sep 03 03:56:21.890893 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: User-Agent: python-urllib3/1.26.12 Sep 03 03:56:21.890893 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Auth-Token: gAAAAABjEtBllYkaiX2PFGAgBX0qSPJz2ZxL_kP1Nl5FUiakngOdRQxb5h2BbpWjnokpENJV0wmx4GBwtk0zPtQfeK7iwHCzZeo8RKlSY4bf5fY7qC_ija9gEbMk0TYDFH_1SSlnOcvVtMY10UxJS8teN-Wb26XgnHhnp-38ad1rLOx0kutXly0 Sep 03 03:56:21.890893 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Id: None Sep 03 03:56:21.890893 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Name: None Sep 03 03:56:21.890893 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Identity-Status: Confirmed Sep 03 03:56:21.890893 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Is-Admin-Project: True Sep 03 03:56:21.890893 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Id: default Sep 03 03:56:21.890893 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Name: Default Sep 03 03:56:21.890893 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Id: 0c500af6dea04db19c4d6e864220c5dd Sep 03 03:56:21.890893 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Name: tempest-VolumesNegativeTest-1596523036 Sep 03 03:56:21.890893 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Role: member,reader Sep 03 03:56:21.890893 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Roles: member,reader Sep 03 03:56:21.892506 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c500af6dea04db19c4d6e864220c5dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0c500af6dea04db19c4d6e864220c5dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0c500af6dea04db19c4d6e864220c5dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c500af6dea04db19c4d6e864220c5dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:56:21.892506 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant: tempest-VolumesNegativeTest-1596523036 Sep 03 03:56:21.892506 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Id: 0c500af6dea04db19c4d6e864220c5dd Sep 03 03:56:21.892506 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Name: tempest-VolumesNegativeTest-1596523036 Sep 03 03:56:21.892506 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User: tempest-VolumesNegativeTest-1596523036-project Sep 03 03:56:21.892506 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Id: default Sep 03 03:56:21.892506 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Name: Default Sep 03 03:56:21.892506 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Id: 3ab0e446f4a146ceb3b80e8cfa676b41 Sep 03 03:56:21.892506 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Name: tempest-VolumesNegativeTest-1596523036-project Sep 03 03:56:21.892506 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Sep 03 03:56:21.892506 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-403320799", "metadata": {"Type": "work"}}} Sep 03 03:56:21.892506 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: method: Sep 03 03:56:21.892506 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 03 03:56:21.893757 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-403320799', 'metadata': {'Type': 'work'}}}} Sep 03 03:56:21.893757 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:56:21.893757 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:21.893757 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 03:56:21.893757 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 03:56:21.893757 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 03:56:21.893757 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise error Sep 03 03:56:21.893757 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 03 03:56:21.893757 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:21.893757 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 03 03:56:21.893757 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 03 03:56:21.893757 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:21.893757 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 03 03:56:21.893757 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi '' Sep 03 03:56:21.893757 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:21.893757 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:21.893757 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:21.893757 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:21.893757 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:21.893757 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:21.893757 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:56:21.893757 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:56:21.895510 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 03:56:21.895510 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 03:56:21.895510 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:56:21.895510 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:56:21.895510 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 03:56:21.895510 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 03:56:21.895510 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 03:56:21.895510 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 03:56:21.895510 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 03:56:21.895510 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 03:56:21.895510 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 03 03:56:21.895510 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:21.895510 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:21.895510 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:21.895510 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:21.895510 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:21.895510 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:21.895510 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 03:56:21.895510 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 03:56:21.896966 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 03 03:56:21.896966 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:21.896966 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-d4ee55f0-8f43-404c-a75f-b2dae1de3791 tempest-VolumesNegativeTest-1596523036 tempest-VolumesNegativeTest-1596523036-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=132076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:56:21.896966 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-d4ee55f0-8f43-404c-a75f-b2dae1de3791 tempest-VolumesNegativeTest-1596523036 tempest-VolumesNegativeTest-1596523036-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009598 Sep 03 03:56:21.896966 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 474/963] 10.222.0.25 () {60 vars in 1156 bytes} [Sat Sep 3 03:56:21 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 03:56:21.903644 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-fffe7714-e2a7-448e-943b-b0bd1e786074 tempest-VolumesNegativeTest-1596523036 tempest-VolumesNegativeTest-1596523036-project] Calling method '.version_select at 0x7f45fd41bf70>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:21.935182 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.wsgi [None req-fffe7714-e2a7-448e-943b-b0bd1e786074 tempest-VolumesNegativeTest-1596523036 tempest-VolumesNegativeTest-1596523036-project] HTTP exception thrown: Volume tempest-invalid-1937508015 could not be found. Sep 03 03:56:21.937211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-fffe7714-e2a7-448e-943b-b0bd1e786074 tempest-VolumesNegativeTest-1596523036 tempest-VolumesNegativeTest-1596523036-project] Request method failure captured: Sep 03 03:56:21.937211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1937508015 HTTP/1.1 Sep 03 03:56:21.937211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept: application/json Sep 03 03:56:21.937211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept-Encoding: identity Sep 03 03:56:21.937211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Connection: close Sep 03 03:56:21.937211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Length: 0 Sep 03 03:56:21.937211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Type: application/json Sep 03 03:56:21.937211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Host: 10.222.0.25 Sep 03 03:56:21.937211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Openstack-System-Scope: None Sep 03 03:56:21.937211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: User-Agent: python-urllib3/1.26.12 Sep 03 03:56:21.937211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Auth-Token: gAAAAABjEtBllYkaiX2PFGAgBX0qSPJz2ZxL_kP1Nl5FUiakngOdRQxb5h2BbpWjnokpENJV0wmx4GBwtk0zPtQfeK7iwHCzZeo8RKlSY4bf5fY7qC_ija9gEbMk0TYDFH_1SSlnOcvVtMY10UxJS8teN-Wb26XgnHhnp-38ad1rLOx0kutXly0 Sep 03 03:56:21.937211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Id: None Sep 03 03:56:21.937211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Name: None Sep 03 03:56:21.937211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Identity-Status: Confirmed Sep 03 03:56:21.937211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Is-Admin-Project: True Sep 03 03:56:21.937211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Id: default Sep 03 03:56:21.937211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Name: Default Sep 03 03:56:21.937211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Id: 0c500af6dea04db19c4d6e864220c5dd Sep 03 03:56:21.937211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Name: tempest-VolumesNegativeTest-1596523036 Sep 03 03:56:21.937211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Role: member,reader Sep 03 03:56:21.937211 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Roles: member,reader Sep 03 03:56:21.938866 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c500af6dea04db19c4d6e864220c5dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0c500af6dea04db19c4d6e864220c5dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0c500af6dea04db19c4d6e864220c5dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c500af6dea04db19c4d6e864220c5dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:56:21.938866 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant: tempest-VolumesNegativeTest-1596523036 Sep 03 03:56:21.938866 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Id: 0c500af6dea04db19c4d6e864220c5dd Sep 03 03:56:21.938866 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Name: tempest-VolumesNegativeTest-1596523036 Sep 03 03:56:21.938866 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User: tempest-VolumesNegativeTest-1596523036-project Sep 03 03:56:21.938866 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Id: default Sep 03 03:56:21.938866 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Name: Default Sep 03 03:56:21.938866 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Id: 3ab0e446f4a146ceb3b80e8cfa676b41 Sep 03 03:56:21.938866 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Name: tempest-VolumesNegativeTest-1596523036-project Sep 03 03:56:21.938866 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: method: Sep 03 03:56:21.938866 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: exception: Volume tempest-invalid-1937508015 could not be found. Sep 03 03:56:21.938866 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: action_args: {'id': 'tempest-invalid-1937508015'} Sep 03 03:56:21.938866 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:56:21.939834 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:21.939834 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 03 03:56:21.939834 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 03 03:56:21.939834 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 03 03:56:21.939834 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 03 03:56:21.939834 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 03 03:56:21.939834 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 03 03:56:21.939834 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 03 03:56:21.939834 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 03 03:56:21.939834 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 03 03:56:21.939834 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 03 03:56:21.939834 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 03:56:21.939834 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 03:56:21.939834 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 03:56:21.939834 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 03:56:21.939834 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1937508015 could not be found. (HTTP 404) (Request-ID: req-93f1d1c9-673f-492f-b3b9-7e60be14f330) Sep 03 03:56:21.939834 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:21.939834 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:21.939834 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:21.941177 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:21.941177 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 03 03:56:21.941177 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 03 03:56:21.941177 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 03 03:56:21.941177 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 03 03:56:21.941177 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 03 03:56:21.941177 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 03 03:56:21.941177 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 03 03:56:21.941177 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 03 03:56:21.941177 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 03 03:56:21.941177 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 03 03:56:21.941177 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 03 03:56:21.941177 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 03 03:56:21.941177 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 03 03:56:21.941177 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 03 03:56:21.941177 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 03 03:56:21.941177 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 03 03:56:21.941177 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 03 03:56:21.941177 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 03 03:56:21.942615 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 03:56:21.942615 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 03:56:21.942615 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 03:56:21.942615 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 03:56:21.942615 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1937508015 could not be found. Sep 03 03:56:21.942615 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:21.942615 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:21.942615 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:21.942615 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:21.942615 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:21.942615 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:21.942615 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:56:21.942615 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:56:21.942615 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 03:56:21.942615 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 03:56:21.942615 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:56:21.942615 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:56:21.942615 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 03 03:56:21.942615 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:56:21.942615 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1937508015 could not be found. Sep 03 03:56:21.944708 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:21.944708 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:21.944708 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:21.944708 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:21.944708 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:21.944708 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:21.944708 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:56:21.944708 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:56:21.944708 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1937508015 could not be found. Sep 03 03:56:21.944708 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:21.944708 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-fffe7714-e2a7-448e-943b-b0bd1e786074 tempest-VolumesNegativeTest-1596523036 tempest-VolumesNegativeTest-1596523036-project] Returning 404 to user: Volume tempest-invalid-1937508015 could not be found. {{(pid=132077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:56:21.944708 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-fffe7714-e2a7-448e-943b-b0bd1e786074 tempest-VolumesNegativeTest-1596523036 tempest-VolumesNegativeTest-1596523036-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1937508015" status: 404 len: 99 microversion: 2.1 time: 0.039536 Sep 03 03:56:21.944708 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 490/964] 10.222.0.25 () {58 vars in 1218 bytes} [Sat Sep 3 03:56:21 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1937508015 => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 03:56:21.953795 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-c2209825-4573-433a-9323-0d7e6e3d5165 tempest-VolumesNegativeTest-1596523036 tempest-VolumesNegativeTest-1596523036-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004707 Sep 03 03:56:21.954832 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 475/965] 10.222.0.25 () {58 vars in 1140 bytes} [Sat Sep 3 03:56:21 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 03 03:56:21.963557 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-dd352d55-2bbe-42a1-b136-8d0e15dc9b24 tempest-VolumesNegativeTest-1596523036 tempest-VolumesNegativeTest-1596523036-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003783 Sep 03 03:56:21.964042 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 491/966] 10.222.0.25 () {58 vars in 1137 bytes} [Sat Sep 3 03:56:21 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 03 03:56:21.972508 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-df4cbd2d-3ea8-4fd3-a3fb-9aaae5496c3c tempest-VolumesNegativeTest-1596523036 tempest-VolumesNegativeTest-1596523036-project] Calling method '.version_select at 0x7f45fc4f8ee0>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:22.001951 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.wsgi [None req-df4cbd2d-3ea8-4fd3-a3fb-9aaae5496c3c tempest-VolumesNegativeTest-1596523036 tempest-VolumesNegativeTest-1596523036-project] HTTP exception thrown: Volume af65acc6-226b-46ac-b655-f06d6545b31b could not be found. Sep 03 03:56:22.003921 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-df4cbd2d-3ea8-4fd3-a3fb-9aaae5496c3c tempest-VolumesNegativeTest-1596523036 tempest-VolumesNegativeTest-1596523036-project] Request method failure captured: Sep 03 03:56:22.003921 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: request: DELETE /compute/v2.1/os-volumes/af65acc6-226b-46ac-b655-f06d6545b31b HTTP/1.1 Sep 03 03:56:22.003921 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept: application/json Sep 03 03:56:22.003921 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept-Encoding: identity Sep 03 03:56:22.003921 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Connection: close Sep 03 03:56:22.003921 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Length: 0 Sep 03 03:56:22.003921 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Type: application/json Sep 03 03:56:22.003921 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Host: 10.222.0.25 Sep 03 03:56:22.003921 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Openstack-System-Scope: None Sep 03 03:56:22.003921 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: User-Agent: python-urllib3/1.26.12 Sep 03 03:56:22.003921 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Auth-Token: gAAAAABjEtBllYkaiX2PFGAgBX0qSPJz2ZxL_kP1Nl5FUiakngOdRQxb5h2BbpWjnokpENJV0wmx4GBwtk0zPtQfeK7iwHCzZeo8RKlSY4bf5fY7qC_ija9gEbMk0TYDFH_1SSlnOcvVtMY10UxJS8teN-Wb26XgnHhnp-38ad1rLOx0kutXly0 Sep 03 03:56:22.003921 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Id: None Sep 03 03:56:22.003921 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Name: None Sep 03 03:56:22.003921 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Identity-Status: Confirmed Sep 03 03:56:22.003921 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Is-Admin-Project: True Sep 03 03:56:22.003921 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Id: default Sep 03 03:56:22.003921 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Name: Default Sep 03 03:56:22.003921 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Id: 0c500af6dea04db19c4d6e864220c5dd Sep 03 03:56:22.003921 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Name: tempest-VolumesNegativeTest-1596523036 Sep 03 03:56:22.003921 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Role: member,reader Sep 03 03:56:22.003921 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Roles: member,reader Sep 03 03:56:22.005565 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c500af6dea04db19c4d6e864220c5dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0c500af6dea04db19c4d6e864220c5dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0c500af6dea04db19c4d6e864220c5dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c500af6dea04db19c4d6e864220c5dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:56:22.005565 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant: tempest-VolumesNegativeTest-1596523036 Sep 03 03:56:22.005565 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Id: 0c500af6dea04db19c4d6e864220c5dd Sep 03 03:56:22.005565 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Name: tempest-VolumesNegativeTest-1596523036 Sep 03 03:56:22.005565 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User: tempest-VolumesNegativeTest-1596523036-project Sep 03 03:56:22.005565 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Id: default Sep 03 03:56:22.005565 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Name: Default Sep 03 03:56:22.005565 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Id: 3ab0e446f4a146ceb3b80e8cfa676b41 Sep 03 03:56:22.005565 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Name: tempest-VolumesNegativeTest-1596523036-project Sep 03 03:56:22.005565 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: method: Sep 03 03:56:22.005565 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: exception: Volume af65acc6-226b-46ac-b655-f06d6545b31b could not be found. Sep 03 03:56:22.005565 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: action_args: {'id': 'af65acc6-226b-46ac-b655-f06d6545b31b'} Sep 03 03:56:22.005565 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:56:22.006675 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:22.006675 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 03 03:56:22.006675 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 03 03:56:22.006675 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 03 03:56:22.006675 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 03 03:56:22.006675 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 03 03:56:22.006675 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 03 03:56:22.006675 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 03 03:56:22.006675 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 03 03:56:22.006675 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 03 03:56:22.006675 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 03 03:56:22.006675 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 03:56:22.006675 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 03:56:22.006675 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 03:56:22.006675 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 03:56:22.006675 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume af65acc6-226b-46ac-b655-f06d6545b31b could not be found. (HTTP 404) (Request-ID: req-b324d486-bba8-4c81-91b9-ce550ebf45b1) Sep 03 03:56:22.006675 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:22.006675 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:22.006675 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:22.008034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:22.008034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 03 03:56:22.008034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 03 03:56:22.008034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 03 03:56:22.008034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 03 03:56:22.008034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 03 03:56:22.008034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 03 03:56:22.008034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 03 03:56:22.008034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 03 03:56:22.008034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 03 03:56:22.008034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 03 03:56:22.008034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 03 03:56:22.008034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 03 03:56:22.008034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 03 03:56:22.008034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 03 03:56:22.008034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 03 03:56:22.008034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 03 03:56:22.008034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 03 03:56:22.008034 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 03 03:56:22.010037 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 03:56:22.010037 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 03:56:22.010037 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 03:56:22.010037 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 03:56:22.010037 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume af65acc6-226b-46ac-b655-f06d6545b31b could not be found. Sep 03 03:56:22.010037 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:22.010037 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:22.010037 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:22.010037 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:22.010037 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:22.010037 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:22.010037 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:56:22.010037 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:56:22.010037 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 03:56:22.010037 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 03:56:22.010037 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:56:22.010037 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:56:22.010037 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 03 03:56:22.010037 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:56:22.011623 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume af65acc6-226b-46ac-b655-f06d6545b31b could not be found. Sep 03 03:56:22.011623 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:22.011623 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:22.011623 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:22.011623 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:22.011623 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:22.011623 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:22.011623 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:56:22.011623 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:56:22.011623 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume af65acc6-226b-46ac-b655-f06d6545b31b could not be found. Sep 03 03:56:22.011623 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 03:56:22.011623 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-df4cbd2d-3ea8-4fd3-a3fb-9aaae5496c3c tempest-VolumesNegativeTest-1596523036 tempest-VolumesNegativeTest-1596523036-project] Returning 404 to user: Volume af65acc6-226b-46ac-b655-f06d6545b31b could not be found. {{(pid=132076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:56:22.011623 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-df4cbd2d-3ea8-4fd3-a3fb-9aaae5496c3c tempest-VolumesNegativeTest-1596523036 tempest-VolumesNegativeTest-1596523036-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/af65acc6-226b-46ac-b655-f06d6545b31b" status: 404 len: 109 microversion: 2.1 time: 0.036592 Sep 03 03:56:22.011623 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 476/967] 10.222.0.25 () {58 vars in 1248 bytes} [Sat Sep 3 03:56:21 2022] DELETE /compute/v2.1/os-volumes/af65acc6-226b-46ac-b655-f06d6545b31b => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 03:56:22.017874 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-5b50f739-a2cd-41ae-89fc-3313a57f05a2 tempest-VolumesNegativeTest-1596523036 tempest-VolumesNegativeTest-1596523036-project] Calling method '.version_select at 0x7f45fc58cee0>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:56:22.045596 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.wsgi [None req-5b50f739-a2cd-41ae-89fc-3313a57f05a2 tempest-VolumesNegativeTest-1596523036 tempest-VolumesNegativeTest-1596523036-project] HTTP exception thrown: Volume 1fbab13f-3e25-4528-b7c3-70d541870f5c could not be found. Sep 03 03:56:22.047881 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-5b50f739-a2cd-41ae-89fc-3313a57f05a2 tempest-VolumesNegativeTest-1596523036 tempest-VolumesNegativeTest-1596523036-project] Request method failure captured: Sep 03 03:56:22.047881 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: request: GET /compute/v2.1/os-volumes/1fbab13f-3e25-4528-b7c3-70d541870f5c HTTP/1.1 Sep 03 03:56:22.047881 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept: application/json Sep 03 03:56:22.047881 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept-Encoding: identity Sep 03 03:56:22.047881 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Connection: close Sep 03 03:56:22.047881 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Length: 0 Sep 03 03:56:22.047881 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Type: application/json Sep 03 03:56:22.047881 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Host: 10.222.0.25 Sep 03 03:56:22.047881 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Openstack-System-Scope: None Sep 03 03:56:22.047881 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: User-Agent: python-urllib3/1.26.12 Sep 03 03:56:22.047881 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Auth-Token: gAAAAABjEtBllYkaiX2PFGAgBX0qSPJz2ZxL_kP1Nl5FUiakngOdRQxb5h2BbpWjnokpENJV0wmx4GBwtk0zPtQfeK7iwHCzZeo8RKlSY4bf5fY7qC_ija9gEbMk0TYDFH_1SSlnOcvVtMY10UxJS8teN-Wb26XgnHhnp-38ad1rLOx0kutXly0 Sep 03 03:56:22.047881 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Id: None Sep 03 03:56:22.047881 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Name: None Sep 03 03:56:22.047881 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Identity-Status: Confirmed Sep 03 03:56:22.047881 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Is-Admin-Project: True Sep 03 03:56:22.047881 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Id: default Sep 03 03:56:22.047881 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Name: Default Sep 03 03:56:22.047881 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Id: 0c500af6dea04db19c4d6e864220c5dd Sep 03 03:56:22.047881 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Name: tempest-VolumesNegativeTest-1596523036 Sep 03 03:56:22.047881 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Role: member,reader Sep 03 03:56:22.047881 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Roles: member,reader Sep 03 03:56:22.049487 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c500af6dea04db19c4d6e864220c5dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0c500af6dea04db19c4d6e864220c5dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0c500af6dea04db19c4d6e864220c5dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c500af6dea04db19c4d6e864220c5dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:56:22.049487 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant: tempest-VolumesNegativeTest-1596523036 Sep 03 03:56:22.049487 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Id: 0c500af6dea04db19c4d6e864220c5dd Sep 03 03:56:22.049487 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Name: tempest-VolumesNegativeTest-1596523036 Sep 03 03:56:22.049487 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User: tempest-VolumesNegativeTest-1596523036-project Sep 03 03:56:22.049487 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Id: default Sep 03 03:56:22.049487 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Name: Default Sep 03 03:56:22.049487 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Id: 3ab0e446f4a146ceb3b80e8cfa676b41 Sep 03 03:56:22.049487 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Name: tempest-VolumesNegativeTest-1596523036-project Sep 03 03:56:22.049487 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: method: Sep 03 03:56:22.049487 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: exception: Volume 1fbab13f-3e25-4528-b7c3-70d541870f5c could not be found. Sep 03 03:56:22.049487 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: action_args: {'id': '1fbab13f-3e25-4528-b7c3-70d541870f5c'} Sep 03 03:56:22.049487 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:56:22.050393 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:22.050393 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 03 03:56:22.050393 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 03 03:56:22.050393 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 03 03:56:22.050393 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 03 03:56:22.050393 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 03 03:56:22.050393 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 03 03:56:22.050393 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 03 03:56:22.050393 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 03 03:56:22.050393 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 03 03:56:22.050393 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 03 03:56:22.050393 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 03:56:22.050393 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 03:56:22.050393 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 03:56:22.050393 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 03:56:22.050393 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1fbab13f-3e25-4528-b7c3-70d541870f5c could not be found. (HTTP 404) (Request-ID: req-bc261a84-c266-46b5-ace4-3617db9627ef) Sep 03 03:56:22.050393 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:22.050393 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:22.050393 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:22.051601 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:22.051601 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 03 03:56:22.051601 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 03 03:56:22.051601 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 03 03:56:22.051601 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 03 03:56:22.051601 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 03 03:56:22.051601 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 03 03:56:22.051601 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 03 03:56:22.051601 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 03 03:56:22.051601 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 03 03:56:22.051601 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 03 03:56:22.051601 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 03 03:56:22.051601 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 03 03:56:22.051601 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 03 03:56:22.051601 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 03 03:56:22.051601 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 03 03:56:22.051601 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 03 03:56:22.051601 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 03 03:56:22.051601 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 03 03:56:22.052773 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 03:56:22.052773 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 03:56:22.052773 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 03:56:22.052773 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 03:56:22.052773 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1fbab13f-3e25-4528-b7c3-70d541870f5c could not be found. Sep 03 03:56:22.052773 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:22.052773 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:22.052773 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:22.052773 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:22.052773 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:22.052773 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:22.052773 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:56:22.052773 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:56:22.052773 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 03:56:22.052773 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 03:56:22.052773 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:56:22.052773 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:56:22.052773 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 03 03:56:22.052773 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:56:22.053910 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1fbab13f-3e25-4528-b7c3-70d541870f5c could not be found. Sep 03 03:56:22.053910 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:22.053910 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:56:22.053910 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:22.053910 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:56:22.053910 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:56:22.053910 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:56:22.053910 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:56:22.053910 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:56:22.053910 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1fbab13f-3e25-4528-b7c3-70d541870f5c could not be found. Sep 03 03:56:22.053910 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:56:22.053910 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-5b50f739-a2cd-41ae-89fc-3313a57f05a2 tempest-VolumesNegativeTest-1596523036 tempest-VolumesNegativeTest-1596523036-project] Returning 404 to user: Volume 1fbab13f-3e25-4528-b7c3-70d541870f5c could not be found. {{(pid=132077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:56:22.053910 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-5b50f739-a2cd-41ae-89fc-3313a57f05a2 tempest-VolumesNegativeTest-1596523036 tempest-VolumesNegativeTest-1596523036-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/1fbab13f-3e25-4528-b7c3-70d541870f5c" status: 404 len: 109 microversion: 2.1 time: 0.035394 Sep 03 03:56:22.053910 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 492/968] 10.222.0.25 () {58 vars in 1245 bytes} [Sat Sep 3 03:56:22 2022] GET /compute/v2.1/os-volumes/1fbab13f-3e25-4528-b7c3-70d541870f5c => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 03:57:05.560691 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=9 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:57:05.561904 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:57:05.566121 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-388c2847-c447-4662-838f-5d548a16cb08 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:57:05.566851 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-388c2847-c447-4662-838f-5d548a16cb08 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:57:05.578270 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-388c2847-c447-4662-838f-5d548a16cb08 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:57:05.578757 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-388c2847-c447-4662-838f-5d548a16cb08 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:57:05.579222 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-388c2847-c447-4662-838f-5d548a16cb08 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:57:05.580159 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-388c2847-c447-4662-838f-5d548a16cb08 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:57:05.580587 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-388c2847-c447-4662-838f-5d548a16cb08 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:57:05.581012 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-388c2847-c447-4662-838f-5d548a16cb08 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:57:05.582348 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-4e2c7980-46d5-45ee-8168-c5a1c3c8c794 req-6e073819-3e3b-41e2-bc6c-f2f280bc65fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af98ca5b-174f-43f9-a582-af6ad3342b87", "tag": "60723675-08fc-443b-9199-a4d4fdaeb719"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:57:05.594493 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_api:SELECT=2 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:57:05.595263 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell1:SELECT=14 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:57:05.598907 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-4e2c7980-46d5-45ee-8168-c5a1c3c8c794 req-6e073819-3e3b-41e2-bc6c-f2f280bc65fa service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:57:05.599593 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-4e2c7980-46d5-45ee-8168-c5a1c3c8c794 req-6e073819-3e3b-41e2-bc6c-f2f280bc65fa service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:57:05.600457 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-4e2c7980-46d5-45ee-8168-c5a1c3c8c794 req-6e073819-3e3b-41e2-bc6c-f2f280bc65fa service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:57:05.614696 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-4e2c7980-46d5-45ee-8168-c5a1c3c8c794 req-6e073819-3e3b-41e2-bc6c-f2f280bc65fa service nova] Creating event network-changed:60723675-08fc-443b-9199-a4d4fdaeb719 for instance af98ca5b-174f-43f9-a582-af6ad3342b87 on hv-cinder-79966 Sep 03 03:57:05.617369 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-388c2847-c447-4662-838f-5d548a16cb08 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Going to try to terminate instance {{(pid=132076) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 03:57:05.621003 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-4e2c7980-46d5-45ee-8168-c5a1c3c8c794 req-6e073819-3e3b-41e2-bc6c-f2f280bc65fa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045911 Sep 03 03:57:05.622509 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 493/969] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:57:05.729237 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-388c2847-c447-4662-838f-5d548a16cb08 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "DELETE /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 204 len: 0 microversion: 2.1 time: 0.169795 Sep 03 03:57:05.743107 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-83fddbde-34ab-4e41-b5d5-5335f9fa9b03 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:57:05.743937 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-83fddbde-34ab-4e41-b5d5-5335f9fa9b03 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:57:05.747332 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 477/970] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Sep 3 03:57:05 2022] DELETE /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 03:57:05.751187 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-83fddbde-34ab-4e41-b5d5-5335f9fa9b03 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:57:05.751743 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-83fddbde-34ab-4e41-b5d5-5335f9fa9b03 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:57:05.752277 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-83fddbde-34ab-4e41-b5d5-5335f9fa9b03 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:57:05.753107 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-83fddbde-34ab-4e41-b5d5-5335f9fa9b03 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:57:05.753625 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-83fddbde-34ab-4e41-b5d5-5335f9fa9b03 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:57:05.754124 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-83fddbde-34ab-4e41-b5d5-5335f9fa9b03 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:57:05.957594 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-83fddbde-34ab-4e41-b5d5-5335f9fa9b03 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:57:05.966244 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-83fddbde-34ab-4e41-b5d5-5335f9fa9b03 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1568 microversion: 2.1 time: 0.229478 Sep 03 03:57:05.966981 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 494/971] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:57:05 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1568 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:57:06.990213 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-b434b82d-9f68-40e9-be8c-a04c02a3004c tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:57:06.990998 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-b434b82d-9f68-40e9-be8c-a04c02a3004c tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:57:06.997409 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b434b82d-9f68-40e9-be8c-a04c02a3004c tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:57:06.997884 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b434b82d-9f68-40e9-be8c-a04c02a3004c tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:57:06.998305 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b434b82d-9f68-40e9-be8c-a04c02a3004c tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:57:06.999015 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b434b82d-9f68-40e9-be8c-a04c02a3004c tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:57:06.999455 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b434b82d-9f68-40e9-be8c-a04c02a3004c tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:57:06.999871 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-b434b82d-9f68-40e9-be8c-a04c02a3004c tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:57:07.154908 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-b434b82d-9f68-40e9-be8c-a04c02a3004c tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:57:07.164978 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-b434b82d-9f68-40e9-be8c-a04c02a3004c tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1568 microversion: 2.1 time: 0.178811 Sep 03 03:57:07.172282 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 478/972] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:57:06 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:57:07.826920 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-dbf2e47e-d652-492f-9bd1-c92b46723222 req-e6c84763-a26e-47ea-8fea-4befb0c542e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af98ca5b-174f-43f9-a582-af6ad3342b87", "name": "network-vif-deleted", "tag": "60723675-08fc-443b-9199-a4d4fdaeb719"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:57:07.837463 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-dbf2e47e-d652-492f-9bd1-c92b46723222 req-e6c84763-a26e-47ea-8fea-4befb0c542e9 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:57:07.837934 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-dbf2e47e-d652-492f-9bd1-c92b46723222 req-e6c84763-a26e-47ea-8fea-4befb0c542e9 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:57:07.838350 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-dbf2e47e-d652-492f-9bd1-c92b46723222 req-e6c84763-a26e-47ea-8fea-4befb0c542e9 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:57:07.852264 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-dbf2e47e-d652-492f-9bd1-c92b46723222 req-e6c84763-a26e-47ea-8fea-4befb0c542e9 service nova] Creating event network-vif-deleted:60723675-08fc-443b-9199-a4d4fdaeb719 for instance af98ca5b-174f-43f9-a582-af6ad3342b87 on hv-cinder-79966 Sep 03 03:57:07.857621 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-dbf2e47e-d652-492f-9bd1-c92b46723222 req-e6c84763-a26e-47ea-8fea-4befb0c542e9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035620 Sep 03 03:57:07.858391 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 495/973] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:57:08.189239 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-7c34277b-ff95-442d-b8c5-afbd9bbba6e0 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:57:08.190011 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-7c34277b-ff95-442d-b8c5-afbd9bbba6e0 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:57:08.199594 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7c34277b-ff95-442d-b8c5-afbd9bbba6e0 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:57:08.200226 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7c34277b-ff95-442d-b8c5-afbd9bbba6e0 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:57:08.201369 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7c34277b-ff95-442d-b8c5-afbd9bbba6e0 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:57:08.202434 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7c34277b-ff95-442d-b8c5-afbd9bbba6e0 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:57:08.202971 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7c34277b-ff95-442d-b8c5-afbd9bbba6e0 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:57:08.203365 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7c34277b-ff95-442d-b8c5-afbd9bbba6e0 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:57:08.250073 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7c34277b-ff95-442d-b8c5-afbd9bbba6e0 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:57:08.250865 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7c34277b-ff95-442d-b8c5-afbd9bbba6e0 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:57:08.251515 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7c34277b-ff95-442d-b8c5-afbd9bbba6e0 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:57:08.252218 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.objects.instance [None req-7c34277b-ff95-442d-b8c5-afbd9bbba6e0 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lazy-loading 'fault' on Instance uuid af98ca5b-174f-43f9-a582-af6ad3342b87 {{(pid=132076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 03:57:08.311564 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-7c34277b-ff95-442d-b8c5-afbd9bbba6e0 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687629f84f1f408d8e80a5a1b28eb787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ced06c15af249bf92f546d0a0bfba23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:57:08.320311 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-7c34277b-ff95-442d-b8c5-afbd9bbba6e0 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 200 len: 1223 microversion: 2.1 time: 0.135084 Sep 03 03:57:08.320884 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 479/974] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:57:08 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 1223 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:57:09.345237 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-44c69be6-61af-49b4-9e40-8536aafbf4de tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:57:09.345927 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-44c69be6-61af-49b4-9e40-8536aafbf4de tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] [instance: af98ca5b-174f-43f9-a582-af6ad3342b87] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:57:09.352391 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-44c69be6-61af-49b4-9e40-8536aafbf4de tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:57:09.352872 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-44c69be6-61af-49b4-9e40-8536aafbf4de tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:57:09.353303 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-44c69be6-61af-49b4-9e40-8536aafbf4de tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:57:09.353998 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-44c69be6-61af-49b4-9e40-8536aafbf4de tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:57:09.354446 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-44c69be6-61af-49b4-9e40-8536aafbf4de tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:57:09.354886 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-44c69be6-61af-49b4-9e40-8536aafbf4de tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:57:09.369386 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.wsgi [None req-44c69be6-61af-49b4-9e40-8536aafbf4de tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] HTTP exception thrown: Instance af98ca5b-174f-43f9-a582-af6ad3342b87 could not be found. Sep 03 03:57:09.371115 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-44c69be6-61af-49b4-9e40-8536aafbf4de tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Request method failure captured: Sep 03 03:57:09.371115 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: request: GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 HTTP/1.1 Sep 03 03:57:09.371115 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept: application/json Sep 03 03:57:09.371115 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept-Encoding: identity Sep 03 03:57:09.371115 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Connection: close Sep 03 03:57:09.371115 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Length: 0 Sep 03 03:57:09.371115 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Type: application/json Sep 03 03:57:09.371115 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Host: 10.222.0.25 Sep 03 03:57:09.371115 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Openstack-System-Scope: None Sep 03 03:57:09.371115 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: User-Agent: python-urllib3/1.26.12 Sep 03 03:57:09.371115 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Auth-Token: gAAAAABjEs9YfnFak-L9S9spShz426V4jNelSyk-WjgbF1XDsvs-tQQeRFAAMVigKzDNtAYqaHowDgp3MMS6sPW3Rj1FlmP63eJCVCjU0IPRy1MvSeYNPQZVdGXU2VxMw_ya2I2daZrE2Q4uoXu8LN428CG9k0Pej0iJT-1fIhdY3HviEGS0VQM Sep 03 03:57:09.371115 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Id: None Sep 03 03:57:09.371115 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Name: None Sep 03 03:57:09.371115 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Identity-Status: Confirmed Sep 03 03:57:09.371115 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Is-Admin-Project: True Sep 03 03:57:09.371115 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Id: default Sep 03 03:57:09.371115 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Name: Default Sep 03 03:57:09.371115 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Id: 5ced06c15af249bf92f546d0a0bfba23 Sep 03 03:57:09.371115 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Name: tempest-TestShelveInstance-679842033 Sep 03 03:57:09.371115 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Role: member,reader Sep 03 03:57:09.371115 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Roles: member,reader Sep 03 03:57:09.372853 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ced06c15af249bf92f546d0a0bfba23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5ced06c15af249bf92f546d0a0bfba23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5ced06c15af249bf92f546d0a0bfba23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5ced06c15af249bf92f546d0a0bfba23"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:57:09.372853 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant: tempest-TestShelveInstance-679842033 Sep 03 03:57:09.372853 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Id: 5ced06c15af249bf92f546d0a0bfba23 Sep 03 03:57:09.372853 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Name: tempest-TestShelveInstance-679842033 Sep 03 03:57:09.372853 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User: tempest-TestShelveInstance-679842033-project Sep 03 03:57:09.372853 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Id: default Sep 03 03:57:09.372853 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Name: Default Sep 03 03:57:09.372853 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Id: 687629f84f1f408d8e80a5a1b28eb787 Sep 03 03:57:09.372853 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Name: tempest-TestShelveInstance-679842033-project Sep 03 03:57:09.372853 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: method: > Sep 03 03:57:09.372853 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: exception: Instance af98ca5b-174f-43f9-a582-af6ad3342b87 could not be found. Sep 03 03:57:09.372853 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: action_args: {'id': 'af98ca5b-174f-43f9-a582-af6ad3342b87'} Sep 03 03:57:09.376959 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:57:09.376959 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:57:09.376959 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 03:57:09.376959 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 03:57:09.376959 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 03:57:09.376959 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 03:57:09.376959 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 03:57:09.376959 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 03:57:09.376959 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 03:57:09.376959 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 03:57:09.376959 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af98ca5b-174f-43f9-a582-af6ad3342b87 could not be found. Sep 03 03:57:09.376959 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:57:09.376959 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:57:09.376959 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:57:09.376959 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:57:09.376959 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:57:09.376959 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:57:09.376959 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:57:09.376959 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:57:09.376959 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:57:09.379066 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:57:09.379066 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 03:57:09.379066 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 03:57:09.379066 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 03:57:09.379066 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 03:57:09.379066 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 03:57:09.379066 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:57:09.379066 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af98ca5b-174f-43f9-a582-af6ad3342b87 could not be found. Sep 03 03:57:09.379066 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:57:09.379066 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:57:09.379066 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:57:09.379066 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:57:09.379066 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:57:09.379066 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:57:09.379066 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:57:09.379066 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:57:09.379066 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af98ca5b-174f-43f9-a582-af6ad3342b87 could not be found. Sep 03 03:57:09.379066 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:57:09.380593 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-44c69be6-61af-49b4-9e40-8536aafbf4de tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Returning 404 to user: Instance af98ca5b-174f-43f9-a582-af6ad3342b87 could not be found. {{(pid=132077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:57:09.380593 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-44c69be6-61af-49b4-9e40-8536aafbf4de tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87" status: 404 len: 111 microversion: 2.1 time: 0.032148 Sep 03 03:57:09.380593 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 496/975] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:57:09 2022] GET /compute/v2.1/servers/af98ca5b-174f-43f9-a582-af6ad3342b87 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 03:57:09.537322 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-86f43a91-ab64-498b-9f6c-958227ce6464 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] Calling method '.version_select at 0x7f45fc598700>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:57:09.561534 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-86f43a91-ab64-498b-9f6c-958227ce6464 tempest-TestShelveInstance-679842033 tempest-TestShelveInstance-679842033-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-20485509" status: 202 len: 0 microversion: 2.1 time: 0.028193 Sep 03 03:57:09.562248 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 480/976] 10.222.0.25 () {58 vars in 1248 bytes} [Sat Sep 3 03:57:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-20485509 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 03:57:58.045265 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_api:SELECT=8 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:57:58.046141 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell1:SELECT=12 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:57:58.047605 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 03 03:57:58.047922 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Sat Sep 3 03:57:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.25) !!! Sep 03 03:57:58.059551 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 03 03:57:58.059813 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Sat Sep 3 03:57:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.25) !!! Sep 03 03:57:58.320816 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-8791527a-a69f-4e97-a0c3-fec2b636b2cb tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Action: 'create', calling method: .version_select at 0x7f45fd41bf70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-880761214", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgmbp4BO+meRp0kc1/FLs28Aup6IhG2t52dybJlf8ULaUCKDscj1EK/FVGylqAfXYHUE2fqLbtpBpUoyNpzO+31UBIPNaeWVZkZ7U1uMIuHtpAIbyr00jgnRZa1GIDXcg=="}} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:57:58.362477 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.quota [None req-8791527a-a69f-4e97-a0c3-fec2b636b2cb tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Getting quotas for project f40913ed988e4d3f8164fad43a6e8508. Resources: {'key_pairs'} {{(pid=132077) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 03:57:58.370054 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.quota [None req-8791527a-a69f-4e97-a0c3-fec2b636b2cb tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Getting quotas for user 1b4df8619fbc4d3bb4097fde33a400f7 and project f40913ed988e4d3f8164fad43a6e8508. Resources: {'key_pairs'} {{(pid=132077) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 03:57:58.417256 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-8791527a-a69f-4e97-a0c3-fec2b636b2cb tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.377103 Sep 03 03:57:58.419238 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 497/977] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Sep 3 03:57:58 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:58:01.996474 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:01.997216 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:01.998939 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 03 03:58:02.007097 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-94845d64-7581-4902-97c0-e2d4bc37c4c6 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Action: 'create', calling method: .version_select at 0x7f45fc52dee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-595284289", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBObpIXs/xGbRAvCSv0lDITgn4mAei2DhUrubUFZSQP7xq7YUfAPTLo3BSvhx9HdzUXDv/FVyILSNnTaC+DUcAH5haJA0dyEtE9z8CLI7+PtTdLkYc3Rr9PMg329zqVyWpQ=="}} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:58:02.026516 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.quota [None req-94845d64-7581-4902-97c0-e2d4bc37c4c6 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Getting quotas for project 766e95a843fd4c658750c125427135cf. Resources: {'key_pairs'} {{(pid=132076) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 03:58:02.030516 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.quota [None req-94845d64-7581-4902-97c0-e2d4bc37c4c6 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Getting quotas for user 0a5317994a7443fe8baeff831cd9ee81 and project 766e95a843fd4c658750c125427135cf. Resources: {'key_pairs'} {{(pid=132076) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 03:58:02.055985 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-94845d64-7581-4902-97c0-e2d4bc37c4c6 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.060940 Sep 03 03:58:02.056585 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 481/978] 10.222.0.25 () {60 vars in 1159 bytes} [Sat Sep 3 03:58:01 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:58:02.161881 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-ff2a91ae-b121-47c9-ad18-5b5d2803b1d0 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1836399886", "imageRef": "1405e1d8-3e84-4383-af07-c6be67cda465", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-595284289", "networks": [{"uuid": "cf33196c-bb04-41f2-9cb6-34bf78ff34bd"}]}} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:58:02.217490 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.network.neutron [None req-ff2a91ae-b121-47c9-ad18-5b5d2803b1d0 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] validate_networks() for [('cf33196c-bb04-41f2-9cb6-34bf78ff34bd', None, None, None, None, None)] {{(pid=132077) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 03:58:02.623872 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-ff2a91ae-b121-47c9-ad18-5b5d2803b1d0 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Flavor limits 0:0:0 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 03:58:02.624276 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-ff2a91ae-b121-47c9-ad18-5b5d2803b1d0 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Image limits 0:0:0 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 03:58:02.624735 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-ff2a91ae-b121-47c9-ad18-5b5d2803b1d0 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Flavor pref 0:0:0 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 03:58:02.625129 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-ff2a91ae-b121-47c9-ad18-5b5d2803b1d0 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Image pref 0:0:0 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 03:58:02.625525 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-ff2a91ae-b121-47c9-ad18-5b5d2803b1d0 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 03:58:02.634352 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ff2a91ae-b121-47c9-ad18-5b5d2803b1d0 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:02.634848 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ff2a91ae-b121-47c9-ad18-5b5d2803b1d0 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:02.635278 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ff2a91ae-b121-47c9-ad18-5b5d2803b1d0 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:02.635988 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ff2a91ae-b121-47c9-ad18-5b5d2803b1d0 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:02.636421 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ff2a91ae-b121-47c9-ad18-5b5d2803b1d0 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:02.636858 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ff2a91ae-b121-47c9-ad18-5b5d2803b1d0 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:02.653989 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.quota [None req-ff2a91ae-b121-47c9-ad18-5b5d2803b1d0 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Getting quotas for project 766e95a843fd4c658750c125427135cf. Resources: {'ram', 'instances', 'cores'} {{(pid=132077) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 03:58:02.657905 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.quota [None req-ff2a91ae-b121-47c9-ad18-5b5d2803b1d0 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Getting quotas for user 0a5317994a7443fe8baeff831cd9ee81 and project 766e95a843fd4c658750c125427135cf. Resources: {'ram', 'instances', 'cores'} {{(pid=132077) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 03:58:02.668666 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-ff2a91ae-b121-47c9-ad18-5b5d2803b1d0 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Going to run 1 instances... {{(pid=132077) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 03:58:02.670979 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-ff2a91ae-b121-47c9-ad18-5b5d2803b1d0 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1405e1d8-3e84-4383-af07-c6be67cda465',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132077) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 03:58:02.722915 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-ff2a91ae-b121-47c9-ad18-5b5d2803b1d0 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.565457 Sep 03 03:58:02.723836 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 498/979] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Sep 3 03:58:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 03:58:02.735269 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-b603e220-ee0f-408c-bab8-6541a63ca862 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:58:02.736036 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-b603e220-ee0f-408c-bab8-6541a63ca862 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:02.804010 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-b603e220-ee0f-408c-bab8-6541a63ca862 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:58:02.812319 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-b603e220-ee0f-408c-bab8-6541a63ca862 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1258 microversion: 2.1 time: 0.080914 Sep 03 03:58:02.822827 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 482/980] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:58:02 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1258 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:58:03.835511 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-8e16cbf2-fec8-41fb-9018-74025c04931b tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:58:03.836113 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-8e16cbf2-fec8-41fb-9018-74025c04931b tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:03.852169 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8e16cbf2-fec8-41fb-9018-74025c04931b tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:03.852874 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8e16cbf2-fec8-41fb-9018-74025c04931b tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:03.853460 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8e16cbf2-fec8-41fb-9018-74025c04931b tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:03.854349 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8e16cbf2-fec8-41fb-9018-74025c04931b tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:03.855464 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8e16cbf2-fec8-41fb-9018-74025c04931b tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:03.857682 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8e16cbf2-fec8-41fb-9018-74025c04931b tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:03.946728 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-8e16cbf2-fec8-41fb-9018-74025c04931b tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:58:03.955503 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-8e16cbf2-fec8-41fb-9018-74025c04931b tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1318 microversion: 2.1 time: 0.124292 Sep 03 03:58:03.956383 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 499/981] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:58:03 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1318 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:58:04.983607 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-cf129b2b-414e-48ad-a58d-23e2cfd3bd67 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:58:04.984484 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-cf129b2b-414e-48ad-a58d-23e2cfd3bd67 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:05.000749 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cf129b2b-414e-48ad-a58d-23e2cfd3bd67 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:05.003316 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cf129b2b-414e-48ad-a58d-23e2cfd3bd67 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:05.004430 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cf129b2b-414e-48ad-a58d-23e2cfd3bd67 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:05.007227 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cf129b2b-414e-48ad-a58d-23e2cfd3bd67 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:05.017448 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cf129b2b-414e-48ad-a58d-23e2cfd3bd67 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:05.017934 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-cf129b2b-414e-48ad-a58d-23e2cfd3bd67 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:05.293276 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-cf129b2b-414e-48ad-a58d-23e2cfd3bd67 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:58:05.302612 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-cf129b2b-414e-48ad-a58d-23e2cfd3bd67 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1358 microversion: 2.1 time: 0.326133 Sep 03 03:58:05.303971 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 483/982] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:58:04 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1358 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:58:06.330833 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-19df2cb5-d61d-4a6b-9e94-c099d46d9a36 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:58:06.331424 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-19df2cb5-d61d-4a6b-9e94-c099d46d9a36 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:06.338081 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-19df2cb5-d61d-4a6b-9e94-c099d46d9a36 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:06.338558 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-19df2cb5-d61d-4a6b-9e94-c099d46d9a36 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:06.339025 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-19df2cb5-d61d-4a6b-9e94-c099d46d9a36 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:06.339714 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-19df2cb5-d61d-4a6b-9e94-c099d46d9a36 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:06.340190 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-19df2cb5-d61d-4a6b-9e94-c099d46d9a36 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:06.340603 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-19df2cb5-d61d-4a6b-9e94-c099d46d9a36 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:06.482768 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-19df2cb5-d61d-4a6b-9e94-c099d46d9a36 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:58:06.492161 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-19df2cb5-d61d-4a6b-9e94-c099d46d9a36 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1358 microversion: 2.1 time: 0.165003 Sep 03 03:58:06.507551 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 500/983] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:58:06 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:58:07.517416 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-1408e137-f164-436a-aa02-56286e3ac181 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:58:07.519273 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-1408e137-f164-436a-aa02-56286e3ac181 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:07.528409 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1408e137-f164-436a-aa02-56286e3ac181 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:07.529404 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1408e137-f164-436a-aa02-56286e3ac181 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:07.530054 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1408e137-f164-436a-aa02-56286e3ac181 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:07.530859 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1408e137-f164-436a-aa02-56286e3ac181 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:07.531429 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1408e137-f164-436a-aa02-56286e3ac181 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:07.531912 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1408e137-f164-436a-aa02-56286e3ac181 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:07.676680 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-1408e137-f164-436a-aa02-56286e3ac181 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:58:07.684538 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-1408e137-f164-436a-aa02-56286e3ac181 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1358 microversion: 2.1 time: 0.172133 Sep 03 03:58:07.685095 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 484/984] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:58:07 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:58:08.708321 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-fe8b39bb-7c16-4832-84b3-4b17fc619078 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:58:08.710008 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-fe8b39bb-7c16-4832-84b3-4b17fc619078 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:08.721134 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fe8b39bb-7c16-4832-84b3-4b17fc619078 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:08.721699 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fe8b39bb-7c16-4832-84b3-4b17fc619078 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:08.722035 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fe8b39bb-7c16-4832-84b3-4b17fc619078 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:08.722872 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fe8b39bb-7c16-4832-84b3-4b17fc619078 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:08.723652 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fe8b39bb-7c16-4832-84b3-4b17fc619078 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:08.724028 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fe8b39bb-7c16-4832-84b3-4b17fc619078 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:08.889134 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-fe8b39bb-7c16-4832-84b3-4b17fc619078 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:58:08.897706 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-fe8b39bb-7c16-4832-84b3-4b17fc619078 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1358 microversion: 2.1 time: 0.194048 Sep 03 03:58:08.898279 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 501/985] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:58:08 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:58:09.922195 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-a6afeb45-5ae3-4374-a600-d0d6cd75475f tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:58:09.922959 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-a6afeb45-5ae3-4374-a600-d0d6cd75475f tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:09.930693 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a6afeb45-5ae3-4374-a600-d0d6cd75475f tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:09.931178 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a6afeb45-5ae3-4374-a600-d0d6cd75475f tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:09.931612 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a6afeb45-5ae3-4374-a600-d0d6cd75475f tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:09.932332 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a6afeb45-5ae3-4374-a600-d0d6cd75475f tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:09.932760 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a6afeb45-5ae3-4374-a600-d0d6cd75475f tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:09.933189 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a6afeb45-5ae3-4374-a600-d0d6cd75475f tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:10.081299 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-a6afeb45-5ae3-4374-a600-d0d6cd75475f tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:58:10.088693 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-a6afeb45-5ae3-4374-a600-d0d6cd75475f tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1358 microversion: 2.1 time: 0.171426 Sep 03 03:58:10.089250 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 485/986] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:58:09 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:58:11.112938 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-3f6c586f-26c6-4b7c-adb9-75eff643af13 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:58:11.113853 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-3f6c586f-26c6-4b7c-adb9-75eff643af13 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:11.121996 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3f6c586f-26c6-4b7c-adb9-75eff643af13 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:11.122723 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3f6c586f-26c6-4b7c-adb9-75eff643af13 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:11.123357 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3f6c586f-26c6-4b7c-adb9-75eff643af13 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:11.124227 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3f6c586f-26c6-4b7c-adb9-75eff643af13 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:11.125008 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3f6c586f-26c6-4b7c-adb9-75eff643af13 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:11.125430 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3f6c586f-26c6-4b7c-adb9-75eff643af13 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:11.287684 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-3f6c586f-26c6-4b7c-adb9-75eff643af13 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:58:11.298428 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-3f6c586f-26c6-4b7c-adb9-75eff643af13 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1358 microversion: 2.1 time: 0.189936 Sep 03 03:58:11.299375 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 502/987] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:58:11 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:58:12.323747 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-5022617e-69e8-4e7f-853e-e1f1087f3c31 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:58:12.324433 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-5022617e-69e8-4e7f-853e-e1f1087f3c31 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:12.331194 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5022617e-69e8-4e7f-853e-e1f1087f3c31 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:12.331674 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5022617e-69e8-4e7f-853e-e1f1087f3c31 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:12.332096 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5022617e-69e8-4e7f-853e-e1f1087f3c31 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:12.332769 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5022617e-69e8-4e7f-853e-e1f1087f3c31 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:12.333209 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5022617e-69e8-4e7f-853e-e1f1087f3c31 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:12.333620 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5022617e-69e8-4e7f-853e-e1f1087f3c31 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:12.504824 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-5022617e-69e8-4e7f-853e-e1f1087f3c31 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:58:12.512957 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-5022617e-69e8-4e7f-853e-e1f1087f3c31 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1358 microversion: 2.1 time: 0.193070 Sep 03 03:58:12.513516 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 486/988] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:58:12 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:58:13.538520 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-53b7fb2b-b85b-49bf-bc44-722a7d9d60fa tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:58:13.539468 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-53b7fb2b-b85b-49bf-bc44-722a7d9d60fa tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:13.543110 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell0:SELECT=2 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:13.544140 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell0:SELECT=10 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:13.553292 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-53b7fb2b-b85b-49bf-bc44-722a7d9d60fa tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:13.553770 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-53b7fb2b-b85b-49bf-bc44-722a7d9d60fa tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:13.554194 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-53b7fb2b-b85b-49bf-bc44-722a7d9d60fa tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:13.554911 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-53b7fb2b-b85b-49bf-bc44-722a7d9d60fa tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:13.555353 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-53b7fb2b-b85b-49bf-bc44-722a7d9d60fa tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:13.555751 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-53b7fb2b-b85b-49bf-bc44-722a7d9d60fa tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:13.705248 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-53b7fb2b-b85b-49bf-bc44-722a7d9d60fa tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:58:13.713406 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-53b7fb2b-b85b-49bf-bc44-722a7d9d60fa tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1358 microversion: 2.1 time: 0.181210 Sep 03 03:58:13.714131 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 503/989] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:58:13 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:58:14.292829 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-523c795c-e7fb-4f91-aa00-abfa9e95056e req-e2fcf1f7-0703-4a7a-ba9b-d140659ec108 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be342681-0ecf-4d3f-ae1e-038054687964", "tag": "c94f4a79-76fb-4ff7-8a7e-7ca35f492f79"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:58:14.303039 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell0:SELECT=6 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:14.305655 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-523c795c-e7fb-4f91-aa00-abfa9e95056e req-e2fcf1f7-0703-4a7a-ba9b-d140659ec108 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:14.306161 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-523c795c-e7fb-4f91-aa00-abfa9e95056e req-e2fcf1f7-0703-4a7a-ba9b-d140659ec108 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:14.306607 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-523c795c-e7fb-4f91-aa00-abfa9e95056e req-e2fcf1f7-0703-4a7a-ba9b-d140659ec108 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:14.318181 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-523c795c-e7fb-4f91-aa00-abfa9e95056e req-e2fcf1f7-0703-4a7a-ba9b-d140659ec108 service nova] Creating event network-changed:c94f4a79-76fb-4ff7-8a7e-7ca35f492f79 for instance be342681-0ecf-4d3f-ae1e-038054687964 on hv-cinder-79966 Sep 03 03:58:14.323912 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-523c795c-e7fb-4f91-aa00-abfa9e95056e req-e2fcf1f7-0703-4a7a-ba9b-d140659ec108 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036687 Sep 03 03:58:14.325114 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 487/990] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:58:14.739044 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-9d0ecabc-b413-4856-8e15-510341a8dc93 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:58:14.739715 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-9d0ecabc-b413-4856-8e15-510341a8dc93 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:14.746230 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9d0ecabc-b413-4856-8e15-510341a8dc93 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:14.746704 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9d0ecabc-b413-4856-8e15-510341a8dc93 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:14.747160 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9d0ecabc-b413-4856-8e15-510341a8dc93 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:14.747840 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9d0ecabc-b413-4856-8e15-510341a8dc93 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:14.748279 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9d0ecabc-b413-4856-8e15-510341a8dc93 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:14.748690 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9d0ecabc-b413-4856-8e15-510341a8dc93 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:14.880788 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-9d0ecabc-b413-4856-8e15-510341a8dc93 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:58:14.888732 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-9d0ecabc-b413-4856-8e15-510341a8dc93 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1358 microversion: 2.1 time: 0.155876 Sep 03 03:58:14.889283 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 504/991] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:58:14 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:58:15.690610 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-decdb780-4a23-4f9b-829e-223826f2ef42 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-160687502", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-880761214", "security_groups": [{"name": "tempest-secgroup-smoke-1403213854"}], "block_device_mapping_v2": [{"uuid": "a68b3cfa-8c0f-4014-b5d1-bb667ce3e9ff", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "552aeadd-abdb-48a9-afc5-6c5bd1a9dd42"}]}} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:58:15.856377 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.network.neutron [None req-decdb780-4a23-4f9b-829e-223826f2ef42 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] validate_networks() for [('552aeadd-abdb-48a9-afc5-6c5bd1a9dd42', None, None, None, None, None)] {{(pid=132076) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 03:58:15.912359 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-d8556111-7fd7-4b42-a54c-3fdc08ebd0b7 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:58:15.912995 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-d8556111-7fd7-4b42-a54c-3fdc08ebd0b7 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:15.919476 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d8556111-7fd7-4b42-a54c-3fdc08ebd0b7 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:15.919980 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d8556111-7fd7-4b42-a54c-3fdc08ebd0b7 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:15.920390 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d8556111-7fd7-4b42-a54c-3fdc08ebd0b7 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:15.921078 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d8556111-7fd7-4b42-a54c-3fdc08ebd0b7 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:15.921524 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d8556111-7fd7-4b42-a54c-3fdc08ebd0b7 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:15.921940 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d8556111-7fd7-4b42-a54c-3fdc08ebd0b7 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:16.056673 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-d8556111-7fd7-4b42-a54c-3fdc08ebd0b7 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:58:16.064871 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-d8556111-7fd7-4b42-a54c-3fdc08ebd0b7 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1358 microversion: 2.1 time: 0.156509 Sep 03 03:58:16.065736 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 505/992] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:58:15 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:58:16.323428 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-decdb780-4a23-4f9b-829e-223826f2ef42 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Flavor limits 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 03:58:16.324047 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-decdb780-4a23-4f9b-829e-223826f2ef42 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Image limits 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 03:58:16.324709 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-decdb780-4a23-4f9b-829e-223826f2ef42 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Flavor pref 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 03:58:16.325269 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-decdb780-4a23-4f9b-829e-223826f2ef42 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Image pref 0:0:0 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 03:58:16.325823 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.virt.hardware [None req-decdb780-4a23-4f9b-829e-223826f2ef42 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 03:58:16.337854 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-decdb780-4a23-4f9b-829e-223826f2ef42 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:16.338329 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-decdb780-4a23-4f9b-829e-223826f2ef42 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:16.338757 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-decdb780-4a23-4f9b-829e-223826f2ef42 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:16.339504 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-decdb780-4a23-4f9b-829e-223826f2ef42 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:16.339958 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-decdb780-4a23-4f9b-829e-223826f2ef42 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:16.340371 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-decdb780-4a23-4f9b-829e-223826f2ef42 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:16.357351 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.quota [None req-decdb780-4a23-4f9b-829e-223826f2ef42 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Getting quotas for project f40913ed988e4d3f8164fad43a6e8508. Resources: {'ram', 'instances', 'cores'} {{(pid=132076) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 03:58:16.361355 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.quota [None req-decdb780-4a23-4f9b-829e-223826f2ef42 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Getting quotas for user 1b4df8619fbc4d3bb4097fde33a400f7 and project f40913ed988e4d3f8164fad43a6e8508. Resources: {'ram', 'instances', 'cores'} {{(pid=132076) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 03:58:16.418738 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-decdb780-4a23-4f9b-829e-223826f2ef42 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Going to run 1 instances... {{(pid=132076) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 03:58:16.420951 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-decdb780-4a23-4f9b-829e-223826f2ef42 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: b6ffe18c-8f84-4388-a17a-60885c5f9f1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a68b3cfa-8c0f-4014-b5d1-bb667ce3e9ff',volume_size=None,volume_type=None)] {{(pid=132076) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 03:58:16.561100 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-decdb780-4a23-4f9b-829e-223826f2ef42 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.874641 Sep 03 03:58:16.561744 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 488/993] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Sep 3 03:58:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 03:58:16.573914 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-9a9db5b4-2971-4da5-aefe-5178becf5692 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:58:16.574612 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-9a9db5b4-2971-4da5-aefe-5178becf5692 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: b6ffe18c-8f84-4388-a17a-60885c5f9f1c] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:16.631615 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-9a9db5b4-2971-4da5-aefe-5178becf5692 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:58:16.638900 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-9a9db5b4-2971-4da5-aefe-5178becf5692 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c" status: 200 len: 1093 microversion: 2.1 time: 0.069472 Sep 03 03:58:16.639490 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 506/994] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:58:16 2022] GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:58:17.089618 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-bba70e29-ee69-4b7c-923a-6ed43bd8b20d tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:58:17.090230 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-bba70e29-ee69-4b7c-923a-6ed43bd8b20d tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:17.097007 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-bba70e29-ee69-4b7c-923a-6ed43bd8b20d tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:17.097482 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-bba70e29-ee69-4b7c-923a-6ed43bd8b20d tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:17.097905 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-bba70e29-ee69-4b7c-923a-6ed43bd8b20d tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:17.098585 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-bba70e29-ee69-4b7c-923a-6ed43bd8b20d tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:17.099052 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-bba70e29-ee69-4b7c-923a-6ed43bd8b20d tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:17.099463 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-bba70e29-ee69-4b7c-923a-6ed43bd8b20d tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:17.232864 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-bba70e29-ee69-4b7c-923a-6ed43bd8b20d tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:58:17.240897 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-bba70e29-ee69-4b7c-923a-6ed43bd8b20d tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1358 microversion: 2.1 time: 0.155986 Sep 03 03:58:17.241497 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 489/995] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:58:17 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:58:17.661685 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-0f17fa31-6b05-440c-9f0c-9ecc1342ad43 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:58:17.662338 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-0f17fa31-6b05-440c-9f0c-9ecc1342ad43 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: b6ffe18c-8f84-4388-a17a-60885c5f9f1c] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:17.668518 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0f17fa31-6b05-440c-9f0c-9ecc1342ad43 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:17.668990 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0f17fa31-6b05-440c-9f0c-9ecc1342ad43 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:17.669656 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0f17fa31-6b05-440c-9f0c-9ecc1342ad43 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:17.670345 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0f17fa31-6b05-440c-9f0c-9ecc1342ad43 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:17.670792 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0f17fa31-6b05-440c-9f0c-9ecc1342ad43 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:17.671228 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0f17fa31-6b05-440c-9f0c-9ecc1342ad43 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:17.740963 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-0f17fa31-6b05-440c-9f0c-9ecc1342ad43 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:58:17.749843 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-0f17fa31-6b05-440c-9f0c-9ecc1342ad43 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c" status: 200 len: 1209 microversion: 2.1 time: 0.092159 Sep 03 03:58:17.750480 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 507/996] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:58:17 2022] GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c => generated 1209 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:58:18.264892 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-48ec2750-dbca-4351-bf88-a3e69fd4d472 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:58:18.265583 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-48ec2750-dbca-4351-bf88-a3e69fd4d472 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:18.272680 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-48ec2750-dbca-4351-bf88-a3e69fd4d472 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:18.273171 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-48ec2750-dbca-4351-bf88-a3e69fd4d472 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:18.273605 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-48ec2750-dbca-4351-bf88-a3e69fd4d472 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:18.274307 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-48ec2750-dbca-4351-bf88-a3e69fd4d472 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:18.274744 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-48ec2750-dbca-4351-bf88-a3e69fd4d472 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:18.275199 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-48ec2750-dbca-4351-bf88-a3e69fd4d472 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:18.486581 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-48ec2750-dbca-4351-bf88-a3e69fd4d472 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:58:18.495994 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-48ec2750-dbca-4351-bf88-a3e69fd4d472 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1358 microversion: 2.1 time: 0.234876 Sep 03 03:58:18.496675 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 490/997] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:58:18 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1358 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:58:18.773103 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-9c99531e-9d55-415f-b5b4-41b25b6c1ef4 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:58:18.773822 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-9c99531e-9d55-415f-b5b4-41b25b6c1ef4 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: b6ffe18c-8f84-4388-a17a-60885c5f9f1c] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:18.781448 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9c99531e-9d55-415f-b5b4-41b25b6c1ef4 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:18.781448 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9c99531e-9d55-415f-b5b4-41b25b6c1ef4 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:18.781793 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9c99531e-9d55-415f-b5b4-41b25b6c1ef4 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:18.782404 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9c99531e-9d55-415f-b5b4-41b25b6c1ef4 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:18.782879 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9c99531e-9d55-415f-b5b4-41b25b6c1ef4 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:18.783296 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9c99531e-9d55-415f-b5b4-41b25b6c1ef4 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:18.922186 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-9c99531e-9d55-415f-b5b4-41b25b6c1ef4 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:58:18.930586 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-9c99531e-9d55-415f-b5b4-41b25b6c1ef4 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c" status: 200 len: 1265 microversion: 2.1 time: 0.161637 Sep 03 03:58:18.931180 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 508/998] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:58:18 2022] GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:58:19.292716 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-0193fcec-1241-417a-bc16-3ebc7219ae49 req-95262f46-6372-4a09-9d22-dcd25e2812b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6ffe18c-8f84-4388-a17a-60885c5f9f1c", "tag": "bcc82def-e23b-469c-b25e-dc68383ed438"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:58:19.307254 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-0193fcec-1241-417a-bc16-3ebc7219ae49 req-95262f46-6372-4a09-9d22-dcd25e2812b2 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:19.307902 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-0193fcec-1241-417a-bc16-3ebc7219ae49 req-95262f46-6372-4a09-9d22-dcd25e2812b2 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:19.308404 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-0193fcec-1241-417a-bc16-3ebc7219ae49 req-95262f46-6372-4a09-9d22-dcd25e2812b2 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:19.321221 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-0193fcec-1241-417a-bc16-3ebc7219ae49 req-95262f46-6372-4a09-9d22-dcd25e2812b2 service nova] Creating event network-changed:bcc82def-e23b-469c-b25e-dc68383ed438 for instance b6ffe18c-8f84-4388-a17a-60885c5f9f1c on hv-cinder-79966 Sep 03 03:58:19.326105 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-0193fcec-1241-417a-bc16-3ebc7219ae49 req-95262f46-6372-4a09-9d22-dcd25e2812b2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037848 Sep 03 03:58:19.326643 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 491/999] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:58:19.521400 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-c27a5685-88fe-4c6b-839b-eb7e78a19e62 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:58:19.522609 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-c27a5685-88fe-4c6b-839b-eb7e78a19e62 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:19.529531 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c27a5685-88fe-4c6b-839b-eb7e78a19e62 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:19.530020 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c27a5685-88fe-4c6b-839b-eb7e78a19e62 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:19.530440 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c27a5685-88fe-4c6b-839b-eb7e78a19e62 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:19.531398 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c27a5685-88fe-4c6b-839b-eb7e78a19e62 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:19.531609 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c27a5685-88fe-4c6b-839b-eb7e78a19e62 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:19.532052 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c27a5685-88fe-4c6b-839b-eb7e78a19e62 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:19.615417 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-ed689f02-c9f5-461e-9b7f-9bbbb72de459 req-2f1600ed-3f75-481d-ba74-17e94852404a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be342681-0ecf-4d3f-ae1e-038054687964", "name": "network-vif-plugged", "status": "completed", "tag": "c94f4a79-76fb-4ff7-8a7e-7ca35f492f79"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:58:19.635868 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-ed689f02-c9f5-461e-9b7f-9bbbb72de459 req-2f1600ed-3f75-481d-ba74-17e94852404a service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:19.636459 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-ed689f02-c9f5-461e-9b7f-9bbbb72de459 req-2f1600ed-3f75-481d-ba74-17e94852404a service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:19.636986 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-ed689f02-c9f5-461e-9b7f-9bbbb72de459 req-2f1600ed-3f75-481d-ba74-17e94852404a service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:19.653043 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-ed689f02-c9f5-461e-9b7f-9bbbb72de459 req-2f1600ed-3f75-481d-ba74-17e94852404a service nova] Creating event network-vif-plugged:c94f4a79-76fb-4ff7-8a7e-7ca35f492f79 for instance be342681-0ecf-4d3f-ae1e-038054687964 on hv-cinder-79966 Sep 03 03:58:19.661541 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-ed689f02-c9f5-461e-9b7f-9bbbb72de459 req-2f1600ed-3f75-481d-ba74-17e94852404a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052979 Sep 03 03:58:19.662866 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 492/1000] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:58:19.698599 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-c27a5685-88fe-4c6b-839b-eb7e78a19e62 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:58:19.707164 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-c27a5685-88fe-4c6b-839b-eb7e78a19e62 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1358 microversion: 2.1 time: 0.189370 Sep 03 03:58:19.707829 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 509/1001] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:58:19 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:58:19.958494 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-2b1409ac-f627-48b0-b1b1-038393c23bc7 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:58:19.959915 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-2b1409ac-f627-48b0-b1b1-038393c23bc7 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: b6ffe18c-8f84-4388-a17a-60885c5f9f1c] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:19.970649 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2b1409ac-f627-48b0-b1b1-038393c23bc7 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:19.971537 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2b1409ac-f627-48b0-b1b1-038393c23bc7 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:19.972256 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2b1409ac-f627-48b0-b1b1-038393c23bc7 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:19.973398 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2b1409ac-f627-48b0-b1b1-038393c23bc7 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:19.974154 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2b1409ac-f627-48b0-b1b1-038393c23bc7 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:19.974917 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2b1409ac-f627-48b0-b1b1-038393c23bc7 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:20.140227 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-2b1409ac-f627-48b0-b1b1-038393c23bc7 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:58:20.152389 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-2b1409ac-f627-48b0-b1b1-038393c23bc7 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c" status: 200 len: 1265 microversion: 2.1 time: 0.201105 Sep 03 03:58:20.152953 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 493/1002] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:58:19 2022] GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:58:20.734581 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-f9325f3e-8618-4e4b-b930-ecbe8892d218 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:58:20.735742 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-f9325f3e-8618-4e4b-b930-ecbe8892d218 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:20.746870 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f9325f3e-8618-4e4b-b930-ecbe8892d218 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:20.747701 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f9325f3e-8618-4e4b-b930-ecbe8892d218 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:20.748474 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f9325f3e-8618-4e4b-b930-ecbe8892d218 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:20.749623 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f9325f3e-8618-4e4b-b930-ecbe8892d218 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:20.750381 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f9325f3e-8618-4e4b-b930-ecbe8892d218 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:20.751187 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f9325f3e-8618-4e4b-b930-ecbe8892d218 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:21.164200 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-f9325f3e-8618-4e4b-b930-ecbe8892d218 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:58:21.171964 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-f9325f3e-8618-4e4b-b930-ecbe8892d218 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1358 microversion: 2.1 time: 0.444364 Sep 03 03:58:21.172623 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 510/1003] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:58:20 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1358 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:58:21.175353 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-329d45a5-b558-4fd0-a8a3-8936413c29c1 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:58:21.175952 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-329d45a5-b558-4fd0-a8a3-8936413c29c1 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: b6ffe18c-8f84-4388-a17a-60885c5f9f1c] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:21.182889 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-329d45a5-b558-4fd0-a8a3-8936413c29c1 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:21.183374 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-329d45a5-b558-4fd0-a8a3-8936413c29c1 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:21.183794 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-329d45a5-b558-4fd0-a8a3-8936413c29c1 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:21.184484 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-329d45a5-b558-4fd0-a8a3-8936413c29c1 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:21.184929 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-329d45a5-b558-4fd0-a8a3-8936413c29c1 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:21.185391 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-329d45a5-b558-4fd0-a8a3-8936413c29c1 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:21.333697 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-329d45a5-b558-4fd0-a8a3-8936413c29c1 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:58:21.341820 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-329d45a5-b558-4fd0-a8a3-8936413c29c1 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c" status: 200 len: 1265 microversion: 2.1 time: 0.170324 Sep 03 03:58:21.342691 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 494/1004] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:58:21 2022] GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:58:22.198234 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-cc814e87-f5fa-45ef-b300-d960bdfb4c0d tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:58:22.199268 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-cc814e87-f5fa-45ef-b300-d960bdfb4c0d tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:22.210271 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cc814e87-f5fa-45ef-b300-d960bdfb4c0d tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:22.211216 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cc814e87-f5fa-45ef-b300-d960bdfb4c0d tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:22.211764 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cc814e87-f5fa-45ef-b300-d960bdfb4c0d tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:22.212489 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cc814e87-f5fa-45ef-b300-d960bdfb4c0d tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:22.212941 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cc814e87-f5fa-45ef-b300-d960bdfb4c0d tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:22.213364 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cc814e87-f5fa-45ef-b300-d960bdfb4c0d tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:22.346109 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-cc814e87-f5fa-45ef-b300-d960bdfb4c0d tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:58:22.354380 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-cc814e87-f5fa-45ef-b300-d960bdfb4c0d tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1546 microversion: 2.1 time: 0.162736 Sep 03 03:58:22.355353 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 511/1005] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:58:22 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1546 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:58:22.369012 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-981bf800-b6e5-4a2f-bedb-0078d546aef3 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:58:22.369640 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-981bf800-b6e5-4a2f-bedb-0078d546aef3 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: b6ffe18c-8f84-4388-a17a-60885c5f9f1c] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:22.376408 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-981bf800-b6e5-4a2f-bedb-0078d546aef3 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:22.376591 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-f38769c0-69ae-4808-ad4a-ae9c7bffc7c0 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:58:22.376874 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-981bf800-b6e5-4a2f-bedb-0078d546aef3 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:22.377104 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-f38769c0-69ae-4808-ad4a-ae9c7bffc7c0 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:22.377302 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-981bf800-b6e5-4a2f-bedb-0078d546aef3 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:22.378007 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-981bf800-b6e5-4a2f-bedb-0078d546aef3 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:22.378452 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-981bf800-b6e5-4a2f-bedb-0078d546aef3 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:22.378910 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-981bf800-b6e5-4a2f-bedb-0078d546aef3 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:22.382967 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f38769c0-69ae-4808-ad4a-ae9c7bffc7c0 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:22.383489 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f38769c0-69ae-4808-ad4a-ae9c7bffc7c0 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:22.383913 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f38769c0-69ae-4808-ad4a-ae9c7bffc7c0 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:22.384598 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f38769c0-69ae-4808-ad4a-ae9c7bffc7c0 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:22.385042 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f38769c0-69ae-4808-ad4a-ae9c7bffc7c0 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:22.385450 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-f38769c0-69ae-4808-ad4a-ae9c7bffc7c0 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:22.510866 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-981bf800-b6e5-4a2f-bedb-0078d546aef3 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:58:22.519527 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-981bf800-b6e5-4a2f-bedb-0078d546aef3 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c" status: 200 len: 1265 microversion: 2.1 time: 0.154261 Sep 03 03:58:22.520009 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 495/1006] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:58:22 2022] GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:58:22.522971 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-f38769c0-69ae-4808-ad4a-ae9c7bffc7c0 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:58:22.530795 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-f38769c0-69ae-4808-ad4a-ae9c7bffc7c0 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1546 microversion: 2.1 time: 0.157881 Sep 03 03:58:22.531368 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 512/1007] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:58:22 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1546 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:58:22.552348 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-15446566-b8f4-47e6-99f3-8b22f28b9f43 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:58:22.557092 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-15446566-b8f4-47e6-99f3-8b22f28b9f43 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:58:22.557852 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-15446566-b8f4-47e6-99f3-8b22f28b9f43 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Searching by: {'deleted': False, 'project_id': '766e95a843fd4c658750c125427135cf'} {{(pid=132076) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 03:58:22.564505 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-15446566-b8f4-47e6-99f3-8b22f28b9f43 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:22.564974 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-15446566-b8f4-47e6-99f3-8b22f28b9f43 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:22.565402 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-15446566-b8f4-47e6-99f3-8b22f28b9f43 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:22.566110 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-15446566-b8f4-47e6-99f3-8b22f28b9f43 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:22.566553 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-15446566-b8f4-47e6-99f3-8b22f28b9f43 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:22.567001 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-15446566-b8f4-47e6-99f3-8b22f28b9f43 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:22.656364 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.multi_cell_list [None req-15446566-b8f4-47e6-99f3-8b22f28b9f43 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132076) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 03:58:22.764052 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-15446566-b8f4-47e6-99f3-8b22f28b9f43 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.215208 Sep 03 03:58:22.764558 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 496/1008] 10.222.0.25 () {58 vars in 1125 bytes} [Sat Sep 3 03:58:22 2022] GET /compute/v2.1/servers => generated 343 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:58:22.778316 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-e23aff5e-7ca8-4995-8400-eb7ee43969ff tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:58:22.779257 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-e23aff5e-7ca8-4995-8400-eb7ee43969ff tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:22.788242 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e23aff5e-7ca8-4995-8400-eb7ee43969ff tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:22.788909 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e23aff5e-7ca8-4995-8400-eb7ee43969ff tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:22.789315 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e23aff5e-7ca8-4995-8400-eb7ee43969ff tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:22.790327 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e23aff5e-7ca8-4995-8400-eb7ee43969ff tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:22.790975 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e23aff5e-7ca8-4995-8400-eb7ee43969ff tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:22.791546 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e23aff5e-7ca8-4995-8400-eb7ee43969ff tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:22.930678 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-e23aff5e-7ca8-4995-8400-eb7ee43969ff tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:58:22.938836 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-e23aff5e-7ca8-4995-8400-eb7ee43969ff tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1546 microversion: 2.1 time: 0.166120 Sep 03 03:58:22.939445 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 513/1009] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:58:22 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1546 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:58:23.542495 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-1f14a172-f725-4735-8e4b-9dfa7958563e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:58:23.543082 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-1f14a172-f725-4735-8e4b-9dfa7958563e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: b6ffe18c-8f84-4388-a17a-60885c5f9f1c] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:23.549799 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1f14a172-f725-4735-8e4b-9dfa7958563e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:23.550279 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1f14a172-f725-4735-8e4b-9dfa7958563e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:23.550749 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1f14a172-f725-4735-8e4b-9dfa7958563e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:23.551474 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1f14a172-f725-4735-8e4b-9dfa7958563e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:23.551921 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1f14a172-f725-4735-8e4b-9dfa7958563e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:23.552340 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-1f14a172-f725-4735-8e4b-9dfa7958563e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:23.691038 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-1f14a172-f725-4735-8e4b-9dfa7958563e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:58:23.699838 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-1f14a172-f725-4735-8e4b-9dfa7958563e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c" status: 200 len: 1265 microversion: 2.1 time: 0.161461 Sep 03 03:58:23.700413 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 497/1010] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:58:23 2022] GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:58:24.537089 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-556fe80b-b30c-4bf2-a6ba-2e823de973eb tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50d02d8b-fd05-4139-b2ea-2b657be2bc48"}} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:58:24.539546 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-556fe80b-b30c-4bf2-a6ba-2e823de973eb tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:24.546582 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-556fe80b-b30c-4bf2-a6ba-2e823de973eb tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:24.547089 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-556fe80b-b30c-4bf2-a6ba-2e823de973eb tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:24.547517 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-556fe80b-b30c-4bf2-a6ba-2e823de973eb tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:24.548198 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-556fe80b-b30c-4bf2-a6ba-2e823de973eb tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:24.548651 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-556fe80b-b30c-4bf2-a6ba-2e823de973eb tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:24.549062 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-556fe80b-b30c-4bf2-a6ba-2e823de973eb tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:24.724488 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-0a7e8934-cdd9-428e-a2f4-14498439d31b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:58:24.725103 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-0a7e8934-cdd9-428e-a2f4-14498439d31b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: b6ffe18c-8f84-4388-a17a-60885c5f9f1c] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:24.731735 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0a7e8934-cdd9-428e-a2f4-14498439d31b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:24.732220 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0a7e8934-cdd9-428e-a2f4-14498439d31b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:24.732651 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0a7e8934-cdd9-428e-a2f4-14498439d31b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:24.733339 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0a7e8934-cdd9-428e-a2f4-14498439d31b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:24.733800 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0a7e8934-cdd9-428e-a2f4-14498439d31b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:24.734219 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0a7e8934-cdd9-428e-a2f4-14498439d31b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:24.799168 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:24.812146 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-556fe80b-b30c-4bf2-a6ba-2e823de973eb tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "POST /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278858 Sep 03 03:58:24.818496 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 514/1011] 10.222.0.25 () {60 vars in 1323 bytes} [Sat Sep 3 03:58:24 2022] POST /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:58:24.871361 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-0a7e8934-cdd9-428e-a2f4-14498439d31b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:58:24.879473 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-0a7e8934-cdd9-428e-a2f4-14498439d31b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c" status: 200 len: 1265 microversion: 2.1 time: 0.158844 Sep 03 03:58:24.880037 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 498/1012] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:58:24 2022] GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:58:25.905875 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-5f6de410-e6fd-426e-b766-ec4652aadae6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:58:25.906560 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-5f6de410-e6fd-426e-b766-ec4652aadae6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: b6ffe18c-8f84-4388-a17a-60885c5f9f1c] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:25.913654 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5f6de410-e6fd-426e-b766-ec4652aadae6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:25.914127 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5f6de410-e6fd-426e-b766-ec4652aadae6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:25.914829 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5f6de410-e6fd-426e-b766-ec4652aadae6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:25.915540 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5f6de410-e6fd-426e-b766-ec4652aadae6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:25.915985 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5f6de410-e6fd-426e-b766-ec4652aadae6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:25.916386 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-5f6de410-e6fd-426e-b766-ec4652aadae6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:26.054273 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-5f6de410-e6fd-426e-b766-ec4652aadae6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:58:26.062441 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-5f6de410-e6fd-426e-b766-ec4652aadae6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c" status: 200 len: 1265 microversion: 2.1 time: 0.161297 Sep 03 03:58:26.063062 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 515/1013] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:58:25 2022] GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:58:27.085612 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-16bf8984-b38c-436c-a743-0e4c28abcab5 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:58:27.086266 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-16bf8984-b38c-436c-a743-0e4c28abcab5 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: b6ffe18c-8f84-4388-a17a-60885c5f9f1c] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:27.088765 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell0:SELECT=6 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:27.094554 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-16bf8984-b38c-436c-a743-0e4c28abcab5 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:27.095076 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-16bf8984-b38c-436c-a743-0e4c28abcab5 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:27.095501 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-16bf8984-b38c-436c-a743-0e4c28abcab5 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:27.096188 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-16bf8984-b38c-436c-a743-0e4c28abcab5 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:27.096633 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-16bf8984-b38c-436c-a743-0e4c28abcab5 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:27.097047 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-16bf8984-b38c-436c-a743-0e4c28abcab5 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:27.231842 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-16bf8984-b38c-436c-a743-0e4c28abcab5 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:58:27.240052 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-16bf8984-b38c-436c-a743-0e4c28abcab5 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c" status: 200 len: 1265 microversion: 2.1 time: 0.158329 Sep 03 03:58:27.240615 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 499/1014] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:58:27 2022] GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:58:28.263124 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-236e9d87-480a-4247-9115-d018945790f6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:58:28.263662 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-236e9d87-480a-4247-9115-d018945790f6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: b6ffe18c-8f84-4388-a17a-60885c5f9f1c] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:28.266089 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell0:SELECT=2 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:28.266758 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=4 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:28.272863 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-236e9d87-480a-4247-9115-d018945790f6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:28.273346 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-236e9d87-480a-4247-9115-d018945790f6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:28.273784 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-236e9d87-480a-4247-9115-d018945790f6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:28.274529 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-236e9d87-480a-4247-9115-d018945790f6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:28.275051 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-236e9d87-480a-4247-9115-d018945790f6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:28.275481 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-236e9d87-480a-4247-9115-d018945790f6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:28.428021 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-236e9d87-480a-4247-9115-d018945790f6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:58:28.436274 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-236e9d87-480a-4247-9115-d018945790f6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c" status: 200 len: 1265 microversion: 2.1 time: 0.177158 Sep 03 03:58:28.436840 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 516/1015] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:58:28 2022] GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:58:29.464045 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-de598e60-ea3c-48af-8beb-03fa9b1acd38 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:58:29.465398 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-de598e60-ea3c-48af-8beb-03fa9b1acd38 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: b6ffe18c-8f84-4388-a17a-60885c5f9f1c] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:29.480328 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-de598e60-ea3c-48af-8beb-03fa9b1acd38 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:29.481350 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-de598e60-ea3c-48af-8beb-03fa9b1acd38 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:29.482291 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-de598e60-ea3c-48af-8beb-03fa9b1acd38 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:29.483409 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-de598e60-ea3c-48af-8beb-03fa9b1acd38 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:29.483964 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-de598e60-ea3c-48af-8beb-03fa9b1acd38 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:29.484482 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-de598e60-ea3c-48af-8beb-03fa9b1acd38 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:29.630455 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-de598e60-ea3c-48af-8beb-03fa9b1acd38 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:58:29.638342 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-de598e60-ea3c-48af-8beb-03fa9b1acd38 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c" status: 200 len: 1265 microversion: 2.1 time: 0.181568 Sep 03 03:58:29.639303 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 500/1016] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:58:29 2022] GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:58:29.695259 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-d0490406-7d27-4050-9e37-da1be08ef2f8 req-15d4713a-c1fd-48a6-bdf4-6c101a30874f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6ffe18c-8f84-4388-a17a-60885c5f9f1c", "name": "network-vif-plugged", "status": "completed", "tag": "bcc82def-e23b-469c-b25e-dc68383ed438"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:58:29.706310 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-d0490406-7d27-4050-9e37-da1be08ef2f8 req-15d4713a-c1fd-48a6-bdf4-6c101a30874f service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:29.706894 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-d0490406-7d27-4050-9e37-da1be08ef2f8 req-15d4713a-c1fd-48a6-bdf4-6c101a30874f service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:29.707324 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-d0490406-7d27-4050-9e37-da1be08ef2f8 req-15d4713a-c1fd-48a6-bdf4-6c101a30874f service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:29.721594 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-d0490406-7d27-4050-9e37-da1be08ef2f8 req-15d4713a-c1fd-48a6-bdf4-6c101a30874f service nova] Creating event network-vif-plugged:bcc82def-e23b-469c-b25e-dc68383ed438 for instance b6ffe18c-8f84-4388-a17a-60885c5f9f1c on hv-cinder-79966 Sep 03 03:58:29.725017 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-d0490406-7d27-4050-9e37-da1be08ef2f8 req-15d4713a-c1fd-48a6-bdf4-6c101a30874f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033617 Sep 03 03:58:29.725600 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 517/1017] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 03:58:30.665536 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-2e6055f4-79ec-4138-8338-aff4ee049d4c tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:58:30.666268 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-2e6055f4-79ec-4138-8338-aff4ee049d4c tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: b6ffe18c-8f84-4388-a17a-60885c5f9f1c] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:30.674349 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2e6055f4-79ec-4138-8338-aff4ee049d4c tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:30.674963 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2e6055f4-79ec-4138-8338-aff4ee049d4c tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:30.675464 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2e6055f4-79ec-4138-8338-aff4ee049d4c tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:30.676263 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2e6055f4-79ec-4138-8338-aff4ee049d4c tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:30.676785 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2e6055f4-79ec-4138-8338-aff4ee049d4c tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:30.677270 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2e6055f4-79ec-4138-8338-aff4ee049d4c tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:30.823663 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-2e6055f4-79ec-4138-8338-aff4ee049d4c tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:58:30.827130 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell1:SELECT=100 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:30.832483 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-2e6055f4-79ec-4138-8338-aff4ee049d4c tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c" status: 200 len: 1265 microversion: 2.1 time: 0.173587 Sep 03 03:58:30.833072 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 501/1018] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:58:30 2022] GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:58:31.858317 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-fd4e86eb-f933-412d-a3a2-df0e799fd90a tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:58:31.859058 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-fd4e86eb-f933-412d-a3a2-df0e799fd90a tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: b6ffe18c-8f84-4388-a17a-60885c5f9f1c] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:31.866494 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fd4e86eb-f933-412d-a3a2-df0e799fd90a tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:31.866999 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fd4e86eb-f933-412d-a3a2-df0e799fd90a tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:31.867620 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fd4e86eb-f933-412d-a3a2-df0e799fd90a tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:31.868388 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fd4e86eb-f933-412d-a3a2-df0e799fd90a tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:31.868836 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fd4e86eb-f933-412d-a3a2-df0e799fd90a tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:31.869256 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-fd4e86eb-f933-412d-a3a2-df0e799fd90a tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:32.011112 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-fd4e86eb-f933-412d-a3a2-df0e799fd90a tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:58:32.019187 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-fd4e86eb-f933-412d-a3a2-df0e799fd90a tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c" status: 200 len: 1452 microversion: 2.1 time: 0.167111 Sep 03 03:58:32.019761 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 518/1019] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:58:31 2022] GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c => generated 1452 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:58:32.041613 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-fc8a3658-b57f-4ebb-8578-766c0a9e4a7d tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:58:32.042107 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-fc8a3658-b57f-4ebb-8578-766c0a9e4a7d tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: b6ffe18c-8f84-4388-a17a-60885c5f9f1c] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:32.044628 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:32.049779 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fc8a3658-b57f-4ebb-8578-766c0a9e4a7d tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:32.050263 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fc8a3658-b57f-4ebb-8578-766c0a9e4a7d tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:32.050683 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fc8a3658-b57f-4ebb-8578-766c0a9e4a7d tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:32.051388 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fc8a3658-b57f-4ebb-8578-766c0a9e4a7d tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:32.051828 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fc8a3658-b57f-4ebb-8578-766c0a9e4a7d tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:32.052239 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-fc8a3658-b57f-4ebb-8578-766c0a9e4a7d tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:32.194709 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-fc8a3658-b57f-4ebb-8578-766c0a9e4a7d tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:58:32.202983 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-fc8a3658-b57f-4ebb-8578-766c0a9e4a7d tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c" status: 200 len: 1452 microversion: 2.1 time: 0.165406 Sep 03 03:58:32.203557 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 502/1020] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:58:32 2022] GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:58:32.454701 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-a5eb8124-2af6-4f5b-adc7-8d4affdf0946 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:58:32.455474 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-a5eb8124-2af6-4f5b-adc7-8d4affdf0946 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:32.461898 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a5eb8124-2af6-4f5b-adc7-8d4affdf0946 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:32.462437 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a5eb8124-2af6-4f5b-adc7-8d4affdf0946 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:32.463019 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a5eb8124-2af6-4f5b-adc7-8d4affdf0946 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:32.463719 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a5eb8124-2af6-4f5b-adc7-8d4affdf0946 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:32.464177 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a5eb8124-2af6-4f5b-adc7-8d4affdf0946 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:32.464607 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a5eb8124-2af6-4f5b-adc7-8d4affdf0946 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:32.662454 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a5eb8124-2af6-4f5b-adc7-8d4affdf0946 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:58:32.671024 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-a5eb8124-2af6-4f5b-adc7-8d4affdf0946 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1592 microversion: 2.1 time: 0.220397 Sep 03 03:58:32.671622 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 519/1021] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:58:32 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1592 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:58:33.973657 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-0c3d5916-7bf9-4ae1-b202-e23aca73596c req-a125275e-c4e6-453d-881d-3fd27323bae4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6ffe18c-8f84-4388-a17a-60885c5f9f1c", "tag": "bcc82def-e23b-469c-b25e-dc68383ed438"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:58:33.978509 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell0:SELECT=4 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:33.985438 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-0c3d5916-7bf9-4ae1-b202-e23aca73596c req-a125275e-c4e6-453d-881d-3fd27323bae4 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:33.986128 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-0c3d5916-7bf9-4ae1-b202-e23aca73596c req-a125275e-c4e6-453d-881d-3fd27323bae4 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:33.986339 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-0c3d5916-7bf9-4ae1-b202-e23aca73596c req-a125275e-c4e6-453d-881d-3fd27323bae4 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:33.997915 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-0c3d5916-7bf9-4ae1-b202-e23aca73596c req-a125275e-c4e6-453d-881d-3fd27323bae4 service nova] Creating event network-changed:bcc82def-e23b-469c-b25e-dc68383ed438 for instance b6ffe18c-8f84-4388-a17a-60885c5f9f1c on hv-cinder-79966 Sep 03 03:58:34.003156 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-0c3d5916-7bf9-4ae1-b202-e23aca73596c req-a125275e-c4e6-453d-881d-3fd27323bae4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033025 Sep 03 03:58:34.003996 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 503/1022] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:58:34.456611 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-60dc24a3-a441-4dc8-9c86-0047d03e69a2 req-474d59bd-fb54-4876-a388-002f106271bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be342681-0ecf-4d3f-ae1e-038054687964", "tag": "c94f4a79-76fb-4ff7-8a7e-7ca35f492f79"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:58:34.469698 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-60dc24a3-a441-4dc8-9c86-0047d03e69a2 req-474d59bd-fb54-4876-a388-002f106271bc service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:34.470427 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-60dc24a3-a441-4dc8-9c86-0047d03e69a2 req-474d59bd-fb54-4876-a388-002f106271bc service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:34.471074 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-60dc24a3-a441-4dc8-9c86-0047d03e69a2 req-474d59bd-fb54-4876-a388-002f106271bc service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:34.485872 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-60dc24a3-a441-4dc8-9c86-0047d03e69a2 req-474d59bd-fb54-4876-a388-002f106271bc service nova] Creating event network-changed:c94f4a79-76fb-4ff7-8a7e-7ca35f492f79 for instance be342681-0ecf-4d3f-ae1e-038054687964 on hv-cinder-79966 Sep 03 03:58:34.491448 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-60dc24a3-a441-4dc8-9c86-0047d03e69a2 req-474d59bd-fb54-4876-a388-002f106271bc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039730 Sep 03 03:58:34.492658 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 520/1023] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:58:35.706928 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-028eb51d-c8aa-42fc-812f-c632ef266a1c tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1015386487"}} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:58:35.707545 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-028eb51d-c8aa-42fc-812f-c632ef266a1c tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:35.713818 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-028eb51d-c8aa-42fc-812f-c632ef266a1c tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:35.714334 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-028eb51d-c8aa-42fc-812f-c632ef266a1c tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:35.714768 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-028eb51d-c8aa-42fc-812f-c632ef266a1c tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:35.715492 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-028eb51d-c8aa-42fc-812f-c632ef266a1c tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:35.715943 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-028eb51d-c8aa-42fc-812f-c632ef266a1c tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:35.716369 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-028eb51d-c8aa-42fc-812f-c632ef266a1c tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:35.847879 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.network.security_group_api [None req-028eb51d-c8aa-42fc-812f-c632ef266a1c tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Adding security group 39c1bb55-5754-4ed9-b26e-bae65f84f925 to port c94f4a79-76fb-4ff7-8a7e-7ca35f492f79 Sep 03 03:58:36.162472 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-028eb51d-c8aa-42fc-812f-c632ef266a1c tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "POST /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964/action" status: 202 len: 0 microversion: 2.1 time: 0.460329 Sep 03 03:58:36.163394 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 504/1024] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Sep 3 03:58:35 2022] POST /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964/action => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 03:58:36.173127 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-3711891e-8593-4759-a79a-9c34481eb0a5 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:58:36.174095 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-3711891e-8593-4759-a79a-9c34481eb0a5 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:36.180879 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3711891e-8593-4759-a79a-9c34481eb0a5 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:36.181501 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3711891e-8593-4759-a79a-9c34481eb0a5 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:36.182153 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3711891e-8593-4759-a79a-9c34481eb0a5 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:36.183025 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3711891e-8593-4759-a79a-9c34481eb0a5 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:36.183632 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3711891e-8593-4759-a79a-9c34481eb0a5 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:36.184144 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3711891e-8593-4759-a79a-9c34481eb0a5 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:36.344303 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-3711891e-8593-4759-a79a-9c34481eb0a5 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:58:36.352943 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-3711891e-8593-4759-a79a-9c34481eb0a5 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1758 microversion: 2.1 time: 0.185061 Sep 03 03:58:36.353591 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 521/1025] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:58:36 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1758 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:58:36.513004 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-2b710355-6e00-418a-b102-5fa4f881c53d req-e168481d-3361-4643-86b3-00fccecdea0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be342681-0ecf-4d3f-ae1e-038054687964", "tag": "c94f4a79-76fb-4ff7-8a7e-7ca35f492f79"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:58:36.523178 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-2b710355-6e00-418a-b102-5fa4f881c53d req-e168481d-3361-4643-86b3-00fccecdea0d service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:36.523650 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-2b710355-6e00-418a-b102-5fa4f881c53d req-e168481d-3361-4643-86b3-00fccecdea0d service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:36.524097 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-2b710355-6e00-418a-b102-5fa4f881c53d req-e168481d-3361-4643-86b3-00fccecdea0d service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:36.536592 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-2b710355-6e00-418a-b102-5fa4f881c53d req-e168481d-3361-4643-86b3-00fccecdea0d service nova] Creating event network-changed:c94f4a79-76fb-4ff7-8a7e-7ca35f492f79 for instance be342681-0ecf-4d3f-ae1e-038054687964 on hv-cinder-79966 Sep 03 03:58:36.542089 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-2b710355-6e00-418a-b102-5fa4f881c53d req-e168481d-3361-4643-86b3-00fccecdea0d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032908 Sep 03 03:58:36.542694 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 505/1026] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:58:58.973037 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-d7ca0d1e-88ff-436c-a49f-7e8e8582dd01 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:58:58.976756 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-d7ca0d1e-88ff-436c-a49f-7e8e8582dd01 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:58.981301 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_api:SELECT=11 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:58.982351 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell1:SELECT=34 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:58.990455 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d7ca0d1e-88ff-436c-a49f-7e8e8582dd01 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:58.990948 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d7ca0d1e-88ff-436c-a49f-7e8e8582dd01 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:58.991367 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d7ca0d1e-88ff-436c-a49f-7e8e8582dd01 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:58.992053 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d7ca0d1e-88ff-436c-a49f-7e8e8582dd01 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:58.992492 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d7ca0d1e-88ff-436c-a49f-7e8e8582dd01 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:58.992901 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d7ca0d1e-88ff-436c-a49f-7e8e8582dd01 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:59.069057 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-d7ca0d1e-88ff-436c-a49f-7e8e8582dd01 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "POST /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964/action" status: 202 len: 0 microversion: 2.1 time: 0.102449 Sep 03 03:58:59.069908 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 522/1027] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Sep 3 03:58:58 2022] POST /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 03:58:59.079510 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-c6f1795a-107d-47bf-9b89-3e71db12d577 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:58:59.080200 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-c6f1795a-107d-47bf-9b89-3e71db12d577 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:58:59.082784 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_api:SELECT=7 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:59.083450 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell1:SELECT=14 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:59.089496 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c6f1795a-107d-47bf-9b89-3e71db12d577 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:59.089986 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c6f1795a-107d-47bf-9b89-3e71db12d577 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:59.091243 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c6f1795a-107d-47bf-9b89-3e71db12d577 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:59.092136 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c6f1795a-107d-47bf-9b89-3e71db12d577 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:58:59.092618 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c6f1795a-107d-47bf-9b89-3e71db12d577 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:58:59.093038 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-c6f1795a-107d-47bf-9b89-3e71db12d577 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:58:59.407940 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-c6f1795a-107d-47bf-9b89-3e71db12d577 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:58:59.416662 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-c6f1795a-107d-47bf-9b89-3e71db12d577 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1750 microversion: 2.1 time: 0.341629 Sep 03 03:58:59.417266 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 506/1028] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:58:59 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1750 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:59:00.447952 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-b537ad92-5ff8-47ea-af8a-d4639c67426c tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:59:00.448773 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-b537ad92-5ff8-47ea-af8a-d4639c67426c tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:59:00.457373 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b537ad92-5ff8-47ea-af8a-d4639c67426c tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:00.457840 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b537ad92-5ff8-47ea-af8a-d4639c67426c tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:00.458274 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b537ad92-5ff8-47ea-af8a-d4639c67426c tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:00.459009 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b537ad92-5ff8-47ea-af8a-d4639c67426c tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:00.459480 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b537ad92-5ff8-47ea-af8a-d4639c67426c tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:00.459902 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b537ad92-5ff8-47ea-af8a-d4639c67426c tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:00.661985 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-b537ad92-5ff8-47ea-af8a-d4639c67426c tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:59:00.670633 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-b537ad92-5ff8-47ea-af8a-d4639c67426c tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1755 microversion: 2.1 time: 0.227787 Sep 03 03:59:00.671274 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 523/1029] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:59:00 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1755 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:59:01.698193 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-5014735a-37a8-407b-951f-81ef59ff3d08 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:59:01.699179 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-5014735a-37a8-407b-951f-81ef59ff3d08 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:59:01.709942 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5014735a-37a8-407b-951f-81ef59ff3d08 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:01.710728 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5014735a-37a8-407b-951f-81ef59ff3d08 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:01.711484 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5014735a-37a8-407b-951f-81ef59ff3d08 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:01.712622 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5014735a-37a8-407b-951f-81ef59ff3d08 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:01.713360 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5014735a-37a8-407b-951f-81ef59ff3d08 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:01.714020 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5014735a-37a8-407b-951f-81ef59ff3d08 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:01.876583 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-5014735a-37a8-407b-951f-81ef59ff3d08 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:59:01.884986 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-5014735a-37a8-407b-951f-81ef59ff3d08 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1755 microversion: 2.1 time: 0.193128 Sep 03 03:59:01.885535 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 507/1030] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:59:01 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1755 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:59:02.912590 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-cf69e677-33df-4612-92b3-a69b73326061 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:59:02.913448 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-cf69e677-33df-4612-92b3-a69b73326061 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:59:02.924495 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cf69e677-33df-4612-92b3-a69b73326061 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:02.925304 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cf69e677-33df-4612-92b3-a69b73326061 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:02.926028 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cf69e677-33df-4612-92b3-a69b73326061 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:02.927233 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cf69e677-33df-4612-92b3-a69b73326061 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:02.927989 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cf69e677-33df-4612-92b3-a69b73326061 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:02.928694 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-cf69e677-33df-4612-92b3-a69b73326061 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:03.084221 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-cf69e677-33df-4612-92b3-a69b73326061 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:59:03.092867 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-cf69e677-33df-4612-92b3-a69b73326061 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1755 microversion: 2.1 time: 0.187067 Sep 03 03:59:03.093424 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 524/1031] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:59:02 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1755 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:59:04.120299 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-497f7723-1400-4305-98a2-d9062a031c85 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:59:04.121181 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-497f7723-1400-4305-98a2-d9062a031c85 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:59:04.132030 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-497f7723-1400-4305-98a2-d9062a031c85 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:04.132832 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-497f7723-1400-4305-98a2-d9062a031c85 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:04.133548 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-497f7723-1400-4305-98a2-d9062a031c85 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:04.134679 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-497f7723-1400-4305-98a2-d9062a031c85 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:04.135471 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-497f7723-1400-4305-98a2-d9062a031c85 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:04.136174 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-497f7723-1400-4305-98a2-d9062a031c85 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:04.282875 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-497f7723-1400-4305-98a2-d9062a031c85 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:59:04.291435 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-497f7723-1400-4305-98a2-d9062a031c85 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1755 microversion: 2.1 time: 0.177819 Sep 03 03:59:04.292009 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 508/1032] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:59:04 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:59:05.315649 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-973c8123-6ef6-4826-8fe9-a196d4a8e336 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:59:05.316271 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-973c8123-6ef6-4826-8fe9-a196d4a8e336 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:59:05.323552 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-973c8123-6ef6-4826-8fe9-a196d4a8e336 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:05.324053 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-973c8123-6ef6-4826-8fe9-a196d4a8e336 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:05.324505 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-973c8123-6ef6-4826-8fe9-a196d4a8e336 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:05.325216 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-973c8123-6ef6-4826-8fe9-a196d4a8e336 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:05.325682 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-973c8123-6ef6-4826-8fe9-a196d4a8e336 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:05.326118 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-973c8123-6ef6-4826-8fe9-a196d4a8e336 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:05.474136 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-973c8123-6ef6-4826-8fe9-a196d4a8e336 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:59:05.483525 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-973c8123-6ef6-4826-8fe9-a196d4a8e336 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1755 microversion: 2.1 time: 0.172009 Sep 03 03:59:05.484093 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 525/1033] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:59:05 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:59:06.511027 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-dee1e46f-7855-4bfe-9e32-d485e2f6e4ab tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:59:06.511969 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-dee1e46f-7855-4bfe-9e32-d485e2f6e4ab tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:59:06.521530 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-dee1e46f-7855-4bfe-9e32-d485e2f6e4ab tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:06.522012 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-dee1e46f-7855-4bfe-9e32-d485e2f6e4ab tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:06.522436 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-dee1e46f-7855-4bfe-9e32-d485e2f6e4ab tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:06.523177 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-dee1e46f-7855-4bfe-9e32-d485e2f6e4ab tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:06.523628 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-dee1e46f-7855-4bfe-9e32-d485e2f6e4ab tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:06.524027 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-dee1e46f-7855-4bfe-9e32-d485e2f6e4ab tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:06.675180 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-dee1e46f-7855-4bfe-9e32-d485e2f6e4ab tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:59:06.688202 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-dee1e46f-7855-4bfe-9e32-d485e2f6e4ab tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1755 microversion: 2.1 time: 0.183472 Sep 03 03:59:06.689154 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 509/1034] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:59:06 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:59:07.731215 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-e1bba165-3e92-4319-9a2d-b4dcdb2a69f6 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:59:07.732180 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-e1bba165-3e92-4319-9a2d-b4dcdb2a69f6 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:59:07.741768 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e1bba165-3e92-4319-9a2d-b4dcdb2a69f6 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:07.742246 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e1bba165-3e92-4319-9a2d-b4dcdb2a69f6 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:07.742678 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e1bba165-3e92-4319-9a2d-b4dcdb2a69f6 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:07.743404 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e1bba165-3e92-4319-9a2d-b4dcdb2a69f6 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:07.743853 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e1bba165-3e92-4319-9a2d-b4dcdb2a69f6 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:07.744273 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e1bba165-3e92-4319-9a2d-b4dcdb2a69f6 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:07.895545 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-e1bba165-3e92-4319-9a2d-b4dcdb2a69f6 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:59:07.905194 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-e1bba165-3e92-4319-9a2d-b4dcdb2a69f6 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1755 microversion: 2.1 time: 0.180909 Sep 03 03:59:07.905822 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 526/1035] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:59:07 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:59:08.940283 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-8ef5ef49-6106-4a30-a05e-ac6a8b58f899 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:59:08.941324 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-8ef5ef49-6106-4a30-a05e-ac6a8b58f899 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:59:08.948982 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8ef5ef49-6106-4a30-a05e-ac6a8b58f899 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:08.950170 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8ef5ef49-6106-4a30-a05e-ac6a8b58f899 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:08.950170 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8ef5ef49-6106-4a30-a05e-ac6a8b58f899 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:08.950551 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8ef5ef49-6106-4a30-a05e-ac6a8b58f899 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:08.951057 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8ef5ef49-6106-4a30-a05e-ac6a8b58f899 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:08.951470 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8ef5ef49-6106-4a30-a05e-ac6a8b58f899 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:09.098242 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-8ef5ef49-6106-4a30-a05e-ac6a8b58f899 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:59:09.113926 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-8ef5ef49-6106-4a30-a05e-ac6a8b58f899 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1755 microversion: 2.1 time: 0.179875 Sep 03 03:59:09.114677 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 510/1036] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:59:08 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:59:10.143975 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-9745da8f-87b2-403e-9342-d2236ca703b8 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:59:10.144583 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-9745da8f-87b2-403e-9342-d2236ca703b8 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:59:10.151749 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9745da8f-87b2-403e-9342-d2236ca703b8 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:10.152215 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9745da8f-87b2-403e-9342-d2236ca703b8 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:10.152651 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9745da8f-87b2-403e-9342-d2236ca703b8 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:10.153343 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9745da8f-87b2-403e-9342-d2236ca703b8 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:10.153797 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9745da8f-87b2-403e-9342-d2236ca703b8 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:10.154223 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9745da8f-87b2-403e-9342-d2236ca703b8 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:10.299355 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-9745da8f-87b2-403e-9342-d2236ca703b8 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:59:10.307977 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-9745da8f-87b2-403e-9342-d2236ca703b8 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1755 microversion: 2.1 time: 0.167937 Sep 03 03:59:10.308536 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 527/1037] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:59:10 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:59:11.335711 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-8aa3b200-d624-40e6-882a-107c5632aa4b tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:59:11.336333 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-8aa3b200-d624-40e6-882a-107c5632aa4b tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:59:11.343273 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8aa3b200-d624-40e6-882a-107c5632aa4b tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:11.343758 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8aa3b200-d624-40e6-882a-107c5632aa4b tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:11.344180 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8aa3b200-d624-40e6-882a-107c5632aa4b tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:11.344873 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8aa3b200-d624-40e6-882a-107c5632aa4b tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:11.345323 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8aa3b200-d624-40e6-882a-107c5632aa4b tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:11.345748 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-8aa3b200-d624-40e6-882a-107c5632aa4b tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:11.493832 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-8aa3b200-d624-40e6-882a-107c5632aa4b tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:59:11.502503 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-8aa3b200-d624-40e6-882a-107c5632aa4b tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1755 microversion: 2.1 time: 0.170831 Sep 03 03:59:11.503105 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 511/1038] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:59:11 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:59:12.536689 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-c3755c35-5d06-4133-8922-94ddc8526514 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:59:12.537574 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-c3755c35-5d06-4133-8922-94ddc8526514 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:59:12.548345 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c3755c35-5d06-4133-8922-94ddc8526514 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:12.549130 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c3755c35-5d06-4133-8922-94ddc8526514 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:12.549812 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c3755c35-5d06-4133-8922-94ddc8526514 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:12.551059 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c3755c35-5d06-4133-8922-94ddc8526514 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:12.551695 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c3755c35-5d06-4133-8922-94ddc8526514 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:12.552382 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c3755c35-5d06-4133-8922-94ddc8526514 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:12.701210 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-c3755c35-5d06-4133-8922-94ddc8526514 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:59:12.714357 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-c3755c35-5d06-4133-8922-94ddc8526514 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1755 microversion: 2.1 time: 0.184391 Sep 03 03:59:12.714943 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 528/1039] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:59:12 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:59:13.742998 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-996a61a1-4c06-4570-a011-9f7686c2cf9e tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:59:13.743602 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-996a61a1-4c06-4570-a011-9f7686c2cf9e tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:59:13.750340 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-996a61a1-4c06-4570-a011-9f7686c2cf9e tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:13.751012 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-996a61a1-4c06-4570-a011-9f7686c2cf9e tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:13.751400 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-996a61a1-4c06-4570-a011-9f7686c2cf9e tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:13.752088 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-996a61a1-4c06-4570-a011-9f7686c2cf9e tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:13.752550 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-996a61a1-4c06-4570-a011-9f7686c2cf9e tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:13.752914 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-996a61a1-4c06-4570-a011-9f7686c2cf9e tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:13.909369 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-996a61a1-4c06-4570-a011-9f7686c2cf9e tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:59:13.922602 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-996a61a1-4c06-4570-a011-9f7686c2cf9e tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1755 microversion: 2.1 time: 0.186438 Sep 03 03:59:13.923498 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 512/1040] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:59:13 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1755 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:59:14.952203 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-0cc3f3dd-010a-49b3-bba4-c523bfc5d4e9 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:59:14.953143 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-0cc3f3dd-010a-49b3-bba4-c523bfc5d4e9 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:59:14.964044 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0cc3f3dd-010a-49b3-bba4-c523bfc5d4e9 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:14.964834 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0cc3f3dd-010a-49b3-bba4-c523bfc5d4e9 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:14.965537 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0cc3f3dd-010a-49b3-bba4-c523bfc5d4e9 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:14.966665 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0cc3f3dd-010a-49b3-bba4-c523bfc5d4e9 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:14.967461 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0cc3f3dd-010a-49b3-bba4-c523bfc5d4e9 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:14.968152 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-0cc3f3dd-010a-49b3-bba4-c523bfc5d4e9 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:15.338713 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-0cc3f3dd-010a-49b3-bba4-c523bfc5d4e9 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:59:15.347909 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-0cc3f3dd-010a-49b3-bba4-c523bfc5d4e9 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1755 microversion: 2.1 time: 0.402215 Sep 03 03:59:15.348521 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 529/1041] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:59:14 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1755 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:59:16.376057 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-7f1912b5-0005-450f-9b18-18ffe82c5d58 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:59:16.377046 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-7f1912b5-0005-450f-9b18-18ffe82c5d58 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:59:16.387694 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7f1912b5-0005-450f-9b18-18ffe82c5d58 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:16.388183 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7f1912b5-0005-450f-9b18-18ffe82c5d58 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:16.388612 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7f1912b5-0005-450f-9b18-18ffe82c5d58 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:16.389305 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7f1912b5-0005-450f-9b18-18ffe82c5d58 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:16.389755 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7f1912b5-0005-450f-9b18-18ffe82c5d58 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:16.390170 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7f1912b5-0005-450f-9b18-18ffe82c5d58 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:16.550754 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-7f1912b5-0005-450f-9b18-18ffe82c5d58 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:59:16.561444 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-7f1912b5-0005-450f-9b18-18ffe82c5d58 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1758 microversion: 2.1 time: 0.192015 Sep 03 03:59:16.562008 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 513/1042] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:59:16 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1758 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:59:48.982321 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-05889952-cf68-4563-a260-9d30d464e194 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1015386487"}} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:59:48.983752 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-05889952-cf68-4563-a260-9d30d464e194 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:59:48.986733 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_api:SELECT=16 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:48.987945 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:48.994738 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-05889952-cf68-4563-a260-9d30d464e194 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:48.995251 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-05889952-cf68-4563-a260-9d30d464e194 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:48.995680 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-05889952-cf68-4563-a260-9d30d464e194 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:48.996370 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-05889952-cf68-4563-a260-9d30d464e194 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:48.996817 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-05889952-cf68-4563-a260-9d30d464e194 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:48.997237 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-05889952-cf68-4563-a260-9d30d464e194 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:49.132295 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.network.security_group_api [None req-05889952-cf68-4563-a260-9d30d464e194 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Removing security group 39c1bb55-5754-4ed9-b26e-bae65f84f925 from port c94f4a79-76fb-4ff7-8a7e-7ca35f492f79 Sep 03 03:59:49.444858 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-05889952-cf68-4563-a260-9d30d464e194 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "POST /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964/action" status: 202 len: 0 microversion: 2.1 time: 0.469588 Sep 03 03:59:49.445835 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 530/1043] 10.222.0.25 () {60 vars in 1278 bytes} [Sat Sep 3 03:59:48 2022] POST /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 03:59:49.455401 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-a39452cc-b348-4ad6-ad4f-992758422fa6 req-53d0bf65-e0e2-475f-acbc-69b9341963af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be342681-0ecf-4d3f-ae1e-038054687964", "tag": "c94f4a79-76fb-4ff7-8a7e-7ca35f492f79"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:59:49.466370 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_api:SELECT=16 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:49.467217 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell1:SELECT=48 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:49.472228 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-a39452cc-b348-4ad6-ad4f-992758422fa6 req-53d0bf65-e0e2-475f-acbc-69b9341963af service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:49.472844 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-a39452cc-b348-4ad6-ad4f-992758422fa6 req-53d0bf65-e0e2-475f-acbc-69b9341963af service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:49.475356 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-a39452cc-b348-4ad6-ad4f-992758422fa6 req-53d0bf65-e0e2-475f-acbc-69b9341963af service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:49.493803 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-a39452cc-b348-4ad6-ad4f-992758422fa6 req-53d0bf65-e0e2-475f-acbc-69b9341963af service nova] Creating event network-changed:c94f4a79-76fb-4ff7-8a7e-7ca35f492f79 for instance be342681-0ecf-4d3f-ae1e-038054687964 on hv-cinder-79966 Sep 03 03:59:49.499819 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-a39452cc-b348-4ad6-ad4f-992758422fa6 req-53d0bf65-e0e2-475f-acbc-69b9341963af service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047924 Sep 03 03:59:49.500980 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 514/1044] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:59:50.532563 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-3c4e17b4-b4bc-49ec-a8bc-cdd989530f35 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:59:50.533099 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-3c4e17b4-b4bc-49ec-a8bc-cdd989530f35 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:59:50.539251 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3c4e17b4-b4bc-49ec-a8bc-cdd989530f35 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:50.539727 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3c4e17b4-b4bc-49ec-a8bc-cdd989530f35 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:50.540212 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3c4e17b4-b4bc-49ec-a8bc-cdd989530f35 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:50.540902 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3c4e17b4-b4bc-49ec-a8bc-cdd989530f35 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:50.541351 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3c4e17b4-b4bc-49ec-a8bc-cdd989530f35 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:50.541766 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3c4e17b4-b4bc-49ec-a8bc-cdd989530f35 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:50.626315 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.objects.instance [None req-3c4e17b4-b4bc-49ec-a8bc-cdd989530f35 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lazy-loading 'services' on Instance uuid be342681-0ecf-4d3f-ae1e-038054687964 {{(pid=132077) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 03:59:50.699432 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-3c4e17b4-b4bc-49ec-a8bc-cdd989530f35 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "DELETE /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964/os-volume_attachments/50d02d8b-fd05-4139-b2ea-2b657be2bc48" status: 202 len: 0 microversion: 2.1 time: 0.171227 Sep 03 03:59:50.700106 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 531/1045] 10.222.0.25 () {58 vars in 1416 bytes} [Sat Sep 3 03:59:50 2022] DELETE /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964/os-volume_attachments/50d02d8b-fd05-4139-b2ea-2b657be2bc48 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 03:59:50.709693 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-435dc000-9b12-474e-bd48-c2e284191934 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:59:50.711991 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-435dc000-9b12-474e-bd48-c2e284191934 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:59:50.719331 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-435dc000-9b12-474e-bd48-c2e284191934 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:50.720064 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-435dc000-9b12-474e-bd48-c2e284191934 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:50.720495 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-435dc000-9b12-474e-bd48-c2e284191934 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:50.721192 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-435dc000-9b12-474e-bd48-c2e284191934 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:50.721812 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-435dc000-9b12-474e-bd48-c2e284191934 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:50.722239 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-435dc000-9b12-474e-bd48-c2e284191934 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:50.754460 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-435dc000-9b12-474e-bd48-c2e284191934 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049623 Sep 03 03:59:50.755053 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 515/1046] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Sep 3 03:59:50 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:59:51.516891 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-a6611489-d6ee-4bf3-8f48-8ecc841fc7f1 req-c9c166b3-cd49-450c-be1d-48640299c24b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be342681-0ecf-4d3f-ae1e-038054687964", "tag": "c94f4a79-76fb-4ff7-8a7e-7ca35f492f79"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:59:51.529658 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-a6611489-d6ee-4bf3-8f48-8ecc841fc7f1 req-c9c166b3-cd49-450c-be1d-48640299c24b service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:51.530156 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-a6611489-d6ee-4bf3-8f48-8ecc841fc7f1 req-c9c166b3-cd49-450c-be1d-48640299c24b service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:51.531299 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-a6611489-d6ee-4bf3-8f48-8ecc841fc7f1 req-c9c166b3-cd49-450c-be1d-48640299c24b service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:51.544409 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-a6611489-d6ee-4bf3-8f48-8ecc841fc7f1 req-c9c166b3-cd49-450c-be1d-48640299c24b service nova] Creating event network-changed:c94f4a79-76fb-4ff7-8a7e-7ca35f492f79 for instance be342681-0ecf-4d3f-ae1e-038054687964 on hv-cinder-79966 Sep 03 03:59:51.549557 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-a6611489-d6ee-4bf3-8f48-8ecc841fc7f1 req-c9c166b3-cd49-450c-be1d-48640299c24b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036602 Sep 03 03:59:51.550032 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 532/1047] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:59:51.767716 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-2653f177-b3c4-4e7e-9524-98eb7fce82f8 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:59:51.770105 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-2653f177-b3c4-4e7e-9524-98eb7fce82f8 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:59:51.777159 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2653f177-b3c4-4e7e-9524-98eb7fce82f8 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:51.777686 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2653f177-b3c4-4e7e-9524-98eb7fce82f8 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:51.778165 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2653f177-b3c4-4e7e-9524-98eb7fce82f8 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:51.778967 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2653f177-b3c4-4e7e-9524-98eb7fce82f8 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:51.779457 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2653f177-b3c4-4e7e-9524-98eb7fce82f8 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:51.779898 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-2653f177-b3c4-4e7e-9524-98eb7fce82f8 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:51.809685 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-2653f177-b3c4-4e7e-9524-98eb7fce82f8 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046228 Sep 03 03:59:51.810244 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 516/1048] 10.222.0.25 () {58 vars in 1302 bytes} [Sat Sep 3 03:59:51 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 03:59:51.822313 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-ce4b5a09-f732-4990-a183-d15db5d12ba7 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:59:51.823004 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-ce4b5a09-f732-4990-a183-d15db5d12ba7 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:59:51.829444 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ce4b5a09-f732-4990-a183-d15db5d12ba7 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:51.829950 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ce4b5a09-f732-4990-a183-d15db5d12ba7 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:51.830423 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ce4b5a09-f732-4990-a183-d15db5d12ba7 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:51.831266 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ce4b5a09-f732-4990-a183-d15db5d12ba7 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:51.831751 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ce4b5a09-f732-4990-a183-d15db5d12ba7 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:51.832264 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ce4b5a09-f732-4990-a183-d15db5d12ba7 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:51.914014 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.wsgi [None req-ce4b5a09-f732-4990-a183-d15db5d12ba7 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] HTTP exception thrown: Instance be342681-0ecf-4d3f-ae1e-038054687964 is not attached to volume 50d02d8b-fd05-4139-b2ea-2b657be2bc48 Sep 03 03:59:51.916405 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-ce4b5a09-f732-4990-a183-d15db5d12ba7 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Request method failure captured: Sep 03 03:59:51.916405 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: request: DELETE /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964/os-volume_attachments/50d02d8b-fd05-4139-b2ea-2b657be2bc48 HTTP/1.1 Sep 03 03:59:51.916405 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept: application/json Sep 03 03:59:51.916405 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept-Encoding: identity Sep 03 03:59:51.916405 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Connection: close Sep 03 03:59:51.916405 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Length: 0 Sep 03 03:59:51.916405 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Type: application/json Sep 03 03:59:51.916405 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Host: 10.222.0.25 Sep 03 03:59:51.916405 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Openstack-System-Scope: None Sep 03 03:59:51.916405 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: User-Agent: python-urllib3/1.26.12 Sep 03 03:59:51.916405 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Auth-Token: gAAAAABjEtC1cVKFJ1HR6wUyUfe6AozK7DMt_9MeIKEVPqa3TFKJDJkRO3VHkIHL-k72Y_uWo9xTDRH32WAAPg4If2pGuMPJ-RAZnoytEXr2jBV_wBJGv61R3a1Jfzb3hTowdzz0emqEEn2ZRP6EpJY7rUQujdV3Puxf8vS1syoAZadptGvoddw Sep 03 03:59:51.916405 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Id: None Sep 03 03:59:51.916405 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Name: None Sep 03 03:59:51.916405 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Identity-Status: Confirmed Sep 03 03:59:51.916405 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Is-Admin-Project: True Sep 03 03:59:51.916405 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Id: default Sep 03 03:59:51.916405 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Name: Default Sep 03 03:59:51.916405 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Id: 766e95a843fd4c658750c125427135cf Sep 03 03:59:51.916405 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Name: tempest-TestMinimumBasicScenario-1609741507 Sep 03 03:59:51.916405 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Role: member,reader Sep 03 03:59:51.916405 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Roles: member,reader Sep 03 03:59:51.918206 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/766e95a843fd4c658750c125427135cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_766e95a843fd4c658750c125427135cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/766e95a843fd4c658750c125427135cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/766e95a843fd4c658750c125427135cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:59:51.918206 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant: tempest-TestMinimumBasicScenario-1609741507 Sep 03 03:59:51.918206 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Id: 766e95a843fd4c658750c125427135cf Sep 03 03:59:51.918206 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1609741507 Sep 03 03:59:51.918206 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User: tempest-TestMinimumBasicScenario-1609741507-project Sep 03 03:59:51.918206 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Id: default Sep 03 03:59:51.918206 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Name: Default Sep 03 03:59:51.918206 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Id: 0a5317994a7443fe8baeff831cd9ee81 Sep 03 03:59:51.918206 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Name: tempest-TestMinimumBasicScenario-1609741507-project Sep 03 03:59:51.918206 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: method: > Sep 03 03:59:51.918206 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: exception: Instance be342681-0ecf-4d3f-ae1e-038054687964 is not attached to volume 50d02d8b-fd05-4139-b2ea-2b657be2bc48 Sep 03 03:59:51.919108 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: action_args: {'server_id': 'be342681-0ecf-4d3f-ae1e-038054687964', 'id': '50d02d8b-fd05-4139-b2ea-2b657be2bc48'} Sep 03 03:59:51.919108 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:59:51.919108 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:59:51.919108 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 03 03:59:51.919108 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 03 03:59:51.919108 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 03:59:51.919108 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 03:59:51.919108 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 03 03:59:51.919108 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 03 03:59:51.919108 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 50d02d8b-fd05-4139-b2ea-2b657be2bc48. Sep 03 03:59:51.919108 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:59:51.919108 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:59:51.919108 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:59:51.919108 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:59:51.919108 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:59:51.919108 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:59:51.919108 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:59:51.919108 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:59:51.919108 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:59:51.920514 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:59:51.920514 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 03 03:59:51.920514 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 03 03:59:51.920514 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be342681-0ecf-4d3f-ae1e-038054687964 is not attached to volume 50d02d8b-fd05-4139-b2ea-2b657be2bc48 Sep 03 03:59:51.920514 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:59:51.920514 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:59:51.920514 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:59:51.920514 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:59:51.920514 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:59:51.920514 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:59:51.920514 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:59:51.920514 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:59:51.920514 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be342681-0ecf-4d3f-ae1e-038054687964 is not attached to volume 50d02d8b-fd05-4139-b2ea-2b657be2bc48 Sep 03 03:59:51.920514 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:59:51.920514 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-ce4b5a09-f732-4990-a183-d15db5d12ba7 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Returning 404 to user: Instance be342681-0ecf-4d3f-ae1e-038054687964 is not attached to volume 50d02d8b-fd05-4139-b2ea-2b657be2bc48 {{(pid=132077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:59:51.921656 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-ce4b5a09-f732-4990-a183-d15db5d12ba7 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "DELETE /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964/os-volume_attachments/50d02d8b-fd05-4139-b2ea-2b657be2bc48" status: 404 len: 154 microversion: 2.1 time: 0.101008 Sep 03 03:59:51.921656 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 533/1049] 10.222.0.25 () {58 vars in 1416 bytes} [Sat Sep 3 03:59:51 2022] DELETE /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964/os-volume_attachments/50d02d8b-fd05-4139-b2ea-2b657be2bc48 => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 03:59:53.066795 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-292a7397-f02c-432c-91a8-b3e4de9292d0 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:59:53.067291 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-292a7397-f02c-432c-91a8-b3e4de9292d0 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:59:53.074257 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-292a7397-f02c-432c-91a8-b3e4de9292d0 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:53.074733 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-292a7397-f02c-432c-91a8-b3e4de9292d0 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:53.075194 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-292a7397-f02c-432c-91a8-b3e4de9292d0 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:53.075881 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-292a7397-f02c-432c-91a8-b3e4de9292d0 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:53.076322 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-292a7397-f02c-432c-91a8-b3e4de9292d0 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:53.076735 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-292a7397-f02c-432c-91a8-b3e4de9292d0 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:53.108260 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-292a7397-f02c-432c-91a8-b3e4de9292d0 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Going to try to terminate instance {{(pid=132076) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 03:59:53.186945 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-292a7397-f02c-432c-91a8-b3e4de9292d0 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "DELETE /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 204 len: 0 microversion: 2.1 time: 0.123679 Sep 03 03:59:53.187683 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 517/1050] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Sep 3 03:59:53 2022] DELETE /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 03:59:53.196141 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-9d8cdb4e-0127-4fea-b0da-f685166948b8 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:59:53.196748 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-9d8cdb4e-0127-4fea-b0da-f685166948b8 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:59:53.203388 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9d8cdb4e-0127-4fea-b0da-f685166948b8 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:53.203867 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9d8cdb4e-0127-4fea-b0da-f685166948b8 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:53.204295 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9d8cdb4e-0127-4fea-b0da-f685166948b8 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:53.204984 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9d8cdb4e-0127-4fea-b0da-f685166948b8 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:53.205434 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9d8cdb4e-0127-4fea-b0da-f685166948b8 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:53.205857 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9d8cdb4e-0127-4fea-b0da-f685166948b8 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:53.335516 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-9d8cdb4e-0127-4fea-b0da-f685166948b8 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:59:53.346361 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-9d8cdb4e-0127-4fea-b0da-f685166948b8 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1552 microversion: 2.1 time: 0.153845 Sep 03 03:59:53.347393 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 534/1051] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:59:53 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:59:54.375967 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-56039e2e-640e-4699-953c-35f1923361aa tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:59:54.377205 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-56039e2e-640e-4699-953c-35f1923361aa tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:59:54.388319 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-56039e2e-640e-4699-953c-35f1923361aa tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:54.389125 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-56039e2e-640e-4699-953c-35f1923361aa tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:54.389809 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-56039e2e-640e-4699-953c-35f1923361aa tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:54.390955 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-56039e2e-640e-4699-953c-35f1923361aa tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:54.391710 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-56039e2e-640e-4699-953c-35f1923361aa tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:54.392411 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-56039e2e-640e-4699-953c-35f1923361aa tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:54.535734 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-56039e2e-640e-4699-953c-35f1923361aa tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:59:54.543924 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-56039e2e-640e-4699-953c-35f1923361aa tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1552 microversion: 2.1 time: 0.175051 Sep 03 03:59:54.544511 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 518/1052] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:59:54 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1552 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:59:55.382587 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-0b50dcd5-398c-407d-bec1-ccb5f5de5309 req-23bf4d81-9591-46f4-87e3-bdb331cd06f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be342681-0ecf-4d3f-ae1e-038054687964", "name": "network-vif-deleted", "tag": "c94f4a79-76fb-4ff7-8a7e-7ca35f492f79"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 03:59:55.392373 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-0b50dcd5-398c-407d-bec1-ccb5f5de5309 req-23bf4d81-9591-46f4-87e3-bdb331cd06f1 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:55.392835 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-0b50dcd5-398c-407d-bec1-ccb5f5de5309 req-23bf4d81-9591-46f4-87e3-bdb331cd06f1 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:55.393256 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-0b50dcd5-398c-407d-bec1-ccb5f5de5309 req-23bf4d81-9591-46f4-87e3-bdb331cd06f1 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:55.404407 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-0b50dcd5-398c-407d-bec1-ccb5f5de5309 req-23bf4d81-9591-46f4-87e3-bdb331cd06f1 service nova] Creating event network-vif-deleted:c94f4a79-76fb-4ff7-8a7e-7ca35f492f79 for instance be342681-0ecf-4d3f-ae1e-038054687964 on hv-cinder-79966 Sep 03 03:59:55.409235 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-0b50dcd5-398c-407d-bec1-ccb5f5de5309 req-23bf4d81-9591-46f4-87e3-bdb331cd06f1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086773 Sep 03 03:59:55.409816 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 535/1053] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 03:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 03:59:55.567837 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-d7226eda-d121-4f4c-9c72-1aa79f4ffd0a tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:59:55.568360 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-d7226eda-d121-4f4c-9c72-1aa79f4ffd0a tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:59:55.575264 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d7226eda-d121-4f4c-9c72-1aa79f4ffd0a tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:55.575745 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d7226eda-d121-4f4c-9c72-1aa79f4ffd0a tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:55.576172 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d7226eda-d121-4f4c-9c72-1aa79f4ffd0a tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:55.576867 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d7226eda-d121-4f4c-9c72-1aa79f4ffd0a tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:55.577310 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d7226eda-d121-4f4c-9c72-1aa79f4ffd0a tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:55.577729 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d7226eda-d121-4f4c-9c72-1aa79f4ffd0a tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:55.610627 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d7226eda-d121-4f4c-9c72-1aa79f4ffd0a tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:55.611137 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d7226eda-d121-4f4c-9c72-1aa79f4ffd0a tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:55.611571 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d7226eda-d121-4f4c-9c72-1aa79f4ffd0a tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:55.612016 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.objects.instance [None req-d7226eda-d121-4f4c-9c72-1aa79f4ffd0a tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lazy-loading 'fault' on Instance uuid be342681-0ecf-4d3f-ae1e-038054687964 {{(pid=132076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 03:59:55.657401 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-d7226eda-d121-4f4c-9c72-1aa79f4ffd0a tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5317994a7443fe8baeff831cd9ee81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766e95a843fd4c658750c125427135cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 03:59:55.665649 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-d7226eda-d121-4f4c-9c72-1aa79f4ffd0a tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 200 len: 1348 microversion: 2.1 time: 0.101813 Sep 03 03:59:55.666224 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 519/1054] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:59:55 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 1348 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 03:59:56.694876 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-633eba86-99ad-48d5-8d3a-18c2f0d96f5f tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:59:56.696162 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-633eba86-99ad-48d5-8d3a-18c2f0d96f5f tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] [instance: be342681-0ecf-4d3f-ae1e-038054687964] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 03:59:56.706534 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-633eba86-99ad-48d5-8d3a-18c2f0d96f5f tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:56.707385 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-633eba86-99ad-48d5-8d3a-18c2f0d96f5f tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:56.708091 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-633eba86-99ad-48d5-8d3a-18c2f0d96f5f tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:56.708784 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-633eba86-99ad-48d5-8d3a-18c2f0d96f5f tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 03:59:56.709233 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-633eba86-99ad-48d5-8d3a-18c2f0d96f5f tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 03:59:56.709654 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-633eba86-99ad-48d5-8d3a-18c2f0d96f5f tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 03:59:56.723244 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.wsgi [None req-633eba86-99ad-48d5-8d3a-18c2f0d96f5f tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] HTTP exception thrown: Instance be342681-0ecf-4d3f-ae1e-038054687964 could not be found. Sep 03 03:59:56.724843 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-633eba86-99ad-48d5-8d3a-18c2f0d96f5f tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Request method failure captured: Sep 03 03:59:56.724843 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: request: GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 HTTP/1.1 Sep 03 03:59:56.724843 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept: application/json Sep 03 03:59:56.724843 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept-Encoding: identity Sep 03 03:59:56.724843 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Connection: close Sep 03 03:59:56.724843 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Length: 0 Sep 03 03:59:56.724843 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Type: application/json Sep 03 03:59:56.724843 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Host: 10.222.0.25 Sep 03 03:59:56.724843 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Openstack-System-Scope: None Sep 03 03:59:56.724843 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: User-Agent: python-urllib3/1.26.12 Sep 03 03:59:56.724843 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Auth-Token: gAAAAABjEtC1cVKFJ1HR6wUyUfe6AozK7DMt_9MeIKEVPqa3TFKJDJkRO3VHkIHL-k72Y_uWo9xTDRH32WAAPg4If2pGuMPJ-RAZnoytEXr2jBV_wBJGv61R3a1Jfzb3hTowdzz0emqEEn2ZRP6EpJY7rUQujdV3Puxf8vS1syoAZadptGvoddw Sep 03 03:59:56.724843 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Id: None Sep 03 03:59:56.724843 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Name: None Sep 03 03:59:56.724843 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Identity-Status: Confirmed Sep 03 03:59:56.724843 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Is-Admin-Project: True Sep 03 03:59:56.724843 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Id: default Sep 03 03:59:56.724843 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Name: Default Sep 03 03:59:56.724843 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Id: 766e95a843fd4c658750c125427135cf Sep 03 03:59:56.724843 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Name: tempest-TestMinimumBasicScenario-1609741507 Sep 03 03:59:56.724843 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Role: member,reader Sep 03 03:59:56.724843 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Roles: member,reader Sep 03 03:59:56.726475 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/766e95a843fd4c658750c125427135cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_766e95a843fd4c658750c125427135cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/766e95a843fd4c658750c125427135cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/766e95a843fd4c658750c125427135cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 03:59:56.726475 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant: tempest-TestMinimumBasicScenario-1609741507 Sep 03 03:59:56.726475 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Id: 766e95a843fd4c658750c125427135cf Sep 03 03:59:56.726475 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1609741507 Sep 03 03:59:56.726475 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User: tempest-TestMinimumBasicScenario-1609741507-project Sep 03 03:59:56.726475 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Id: default Sep 03 03:59:56.726475 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Name: Default Sep 03 03:59:56.726475 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Id: 0a5317994a7443fe8baeff831cd9ee81 Sep 03 03:59:56.726475 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Name: tempest-TestMinimumBasicScenario-1609741507-project Sep 03 03:59:56.726475 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: method: > Sep 03 03:59:56.726475 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: exception: Instance be342681-0ecf-4d3f-ae1e-038054687964 could not be found. Sep 03 03:59:56.726475 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: action_args: {'id': 'be342681-0ecf-4d3f-ae1e-038054687964'} Sep 03 03:59:56.727421 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 03:59:56.727421 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:59:56.727421 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 03:59:56.727421 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 03:59:56.727421 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 03:59:56.727421 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 03:59:56.727421 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 03:59:56.727421 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 03:59:56.727421 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 03:59:56.727421 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 03:59:56.727421 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be342681-0ecf-4d3f-ae1e-038054687964 could not be found. Sep 03 03:59:56.727421 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:59:56.727421 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:59:56.727421 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:59:56.727421 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:59:56.727421 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:59:56.727421 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:59:56.727421 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 03:59:56.727421 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 03:59:56.727421 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 03:59:56.729019 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 03:59:56.729019 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 03:59:56.729019 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 03:59:56.729019 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 03:59:56.729019 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 03:59:56.729019 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 03:59:56.729019 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 03:59:56.729019 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be342681-0ecf-4d3f-ae1e-038054687964 could not be found. Sep 03 03:59:56.729019 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:59:56.729019 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 03:59:56.729019 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:59:56.729019 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 03:59:56.729019 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 03:59:56.729019 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 03:59:56.729019 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 03:59:56.729019 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 03:59:56.729019 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be342681-0ecf-4d3f-ae1e-038054687964 could not be found. Sep 03 03:59:56.729019 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 03:59:56.730217 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-633eba86-99ad-48d5-8d3a-18c2f0d96f5f tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Returning 404 to user: Instance be342681-0ecf-4d3f-ae1e-038054687964 could not be found. {{(pid=132077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 03:59:56.730217 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-633eba86-99ad-48d5-8d3a-18c2f0d96f5f tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964" status: 404 len: 111 microversion: 2.1 time: 0.039187 Sep 03 03:59:56.730217 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 536/1055] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 03:59:56 2022] GET /compute/v2.1/servers/be342681-0ecf-4d3f-ae1e-038054687964 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 03:59:56.735398 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-8f2c9f87-7ceb-46ec-bfe2-194970b48e69 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] Calling method '.version_select at 0x7f45fc525ee0>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 03:59:56.757253 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-8f2c9f87-7ceb-46ec-bfe2-194970b48e69 tempest-TestMinimumBasicScenario-1609741507 tempest-TestMinimumBasicScenario-1609741507-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-595284289" status: 202 len: 0 microversion: 2.1 time: 0.025683 Sep 03 03:59:56.757827 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 520/1056] 10.222.0.25 () {58 vars in 1269 bytes} [Sat Sep 3 03:59:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-595284289 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 04:00:31.605296 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-b1641711-8e49-486d-8092-66d29d55a3f0 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:00:31.605927 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-b1641711-8e49-486d-8092-66d29d55a3f0 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: b6ffe18c-8f84-4388-a17a-60885c5f9f1c] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:00:31.608063 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_api:SELECT=14 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:31.608704 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:31.614419 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b1641711-8e49-486d-8092-66d29d55a3f0 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:31.614925 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b1641711-8e49-486d-8092-66d29d55a3f0 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:31.615372 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b1641711-8e49-486d-8092-66d29d55a3f0 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:31.616034 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b1641711-8e49-486d-8092-66d29d55a3f0 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:31.616477 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b1641711-8e49-486d-8092-66d29d55a3f0 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:31.616890 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-b1641711-8e49-486d-8092-66d29d55a3f0 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:31.643038 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-b1641711-8e49-486d-8092-66d29d55a3f0 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: b6ffe18c-8f84-4388-a17a-60885c5f9f1c] Going to try to terminate instance {{(pid=132077) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 04:00:31.728218 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-b1641711-8e49-486d-8092-66d29d55a3f0 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c" status: 204 len: 0 microversion: 2.1 time: 0.127858 Sep 03 04:00:31.729303 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 537/1057] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Sep 3 04:00:31 2022] DELETE /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 04:00:31.735993 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:31.736814 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:31.741050 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-5274bc62-e82b-443e-9fe4-62bef7933b19 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:00:31.741649 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-5274bc62-e82b-443e-9fe4-62bef7933b19 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: b6ffe18c-8f84-4388-a17a-60885c5f9f1c] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:00:31.750764 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5274bc62-e82b-443e-9fe4-62bef7933b19 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:31.751271 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5274bc62-e82b-443e-9fe4-62bef7933b19 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:31.751699 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5274bc62-e82b-443e-9fe4-62bef7933b19 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:31.752388 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5274bc62-e82b-443e-9fe4-62bef7933b19 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:31.752838 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5274bc62-e82b-443e-9fe4-62bef7933b19 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:31.753256 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5274bc62-e82b-443e-9fe4-62bef7933b19 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:31.892563 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-5274bc62-e82b-443e-9fe4-62bef7933b19 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:00:31.900876 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-5274bc62-e82b-443e-9fe4-62bef7933b19 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c" status: 200 len: 1577 microversion: 2.1 time: 0.166867 Sep 03 04:00:31.901444 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 521/1058] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:00:31 2022] GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:00:32.930189 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-83b285df-5d5b-4b37-a09a-016713a8859c tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:00:32.930882 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-83b285df-5d5b-4b37-a09a-016713a8859c tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: b6ffe18c-8f84-4388-a17a-60885c5f9f1c] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:00:32.938039 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-83b285df-5d5b-4b37-a09a-016713a8859c tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:32.938519 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-83b285df-5d5b-4b37-a09a-016713a8859c tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:32.938986 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-83b285df-5d5b-4b37-a09a-016713a8859c tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:32.939699 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-83b285df-5d5b-4b37-a09a-016713a8859c tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:32.940129 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-83b285df-5d5b-4b37-a09a-016713a8859c tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:32.940548 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-83b285df-5d5b-4b37-a09a-016713a8859c tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:33.083787 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-83b285df-5d5b-4b37-a09a-016713a8859c tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:00:33.091743 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-83b285df-5d5b-4b37-a09a-016713a8859c tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c" status: 200 len: 1577 microversion: 2.1 time: 0.170025 Sep 03 04:00:33.092279 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 538/1059] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:00:32 2022] GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:00:34.072244 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-73174392-380c-4d6a-9dea-4b1b4c1de8e3 req-0c891ff4-b42d-4360-840b-e293186d609d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6ffe18c-8f84-4388-a17a-60885c5f9f1c", "name": "network-vif-deleted", "tag": "bcc82def-e23b-469c-b25e-dc68383ed438"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 04:00:34.086415 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-73174392-380c-4d6a-9dea-4b1b4c1de8e3 req-0c891ff4-b42d-4360-840b-e293186d609d service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:34.087315 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-73174392-380c-4d6a-9dea-4b1b4c1de8e3 req-0c891ff4-b42d-4360-840b-e293186d609d service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:34.087806 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-73174392-380c-4d6a-9dea-4b1b4c1de8e3 req-0c891ff4-b42d-4360-840b-e293186d609d service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:34.101745 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-73174392-380c-4d6a-9dea-4b1b4c1de8e3 req-0c891ff4-b42d-4360-840b-e293186d609d service nova] Creating event network-vif-deleted:bcc82def-e23b-469c-b25e-dc68383ed438 for instance b6ffe18c-8f84-4388-a17a-60885c5f9f1c on hv-cinder-79966 Sep 03 04:00:34.107510 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-73174392-380c-4d6a-9dea-4b1b4c1de8e3 req-0c891ff4-b42d-4360-840b-e293186d609d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039536 Sep 03 04:00:34.108111 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 522/1060] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 04:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 04:00:34.116745 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-97c00b09-d497-4cbf-a270-e4b565066dfa tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:00:34.118989 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-97c00b09-d497-4cbf-a270-e4b565066dfa tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: b6ffe18c-8f84-4388-a17a-60885c5f9f1c] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:00:34.132406 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-97c00b09-d497-4cbf-a270-e4b565066dfa tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:34.133121 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-97c00b09-d497-4cbf-a270-e4b565066dfa tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:34.138177 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-97c00b09-d497-4cbf-a270-e4b565066dfa tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:34.139387 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-97c00b09-d497-4cbf-a270-e4b565066dfa tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:34.139949 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-97c00b09-d497-4cbf-a270-e4b565066dfa tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:34.143030 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-97c00b09-d497-4cbf-a270-e4b565066dfa tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:34.221181 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-97c00b09-d497-4cbf-a270-e4b565066dfa tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:00:34.230557 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-97c00b09-d497-4cbf-a270-e4b565066dfa tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c" status: 200 len: 1224 microversion: 2.1 time: 0.118429 Sep 03 04:00:34.231584 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 539/1061] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:00:34 2022] GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c => generated 1224 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:00:35.254758 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-5d72764c-d8e7-4b03-ae88-d14a015bcbdf tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:00:35.255492 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-5d72764c-d8e7-4b03-ae88-d14a015bcbdf tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: b6ffe18c-8f84-4388-a17a-60885c5f9f1c] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:00:35.262203 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5d72764c-d8e7-4b03-ae88-d14a015bcbdf tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:35.262685 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5d72764c-d8e7-4b03-ae88-d14a015bcbdf tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:35.263152 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5d72764c-d8e7-4b03-ae88-d14a015bcbdf tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:35.263869 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5d72764c-d8e7-4b03-ae88-d14a015bcbdf tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:35.264311 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5d72764c-d8e7-4b03-ae88-d14a015bcbdf tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:35.264725 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5d72764c-d8e7-4b03-ae88-d14a015bcbdf tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:35.278154 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.wsgi [None req-5d72764c-d8e7-4b03-ae88-d14a015bcbdf tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] HTTP exception thrown: Instance b6ffe18c-8f84-4388-a17a-60885c5f9f1c could not be found. Sep 03 04:00:35.279812 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-5d72764c-d8e7-4b03-ae88-d14a015bcbdf tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Request method failure captured: Sep 03 04:00:35.279812 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: request: GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c HTTP/1.1 Sep 03 04:00:35.279812 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept: application/json Sep 03 04:00:35.279812 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept-Encoding: identity Sep 03 04:00:35.279812 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Connection: close Sep 03 04:00:35.279812 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Length: 0 Sep 03 04:00:35.279812 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Type: application/json Sep 03 04:00:35.279812 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Host: 10.222.0.25 Sep 03 04:00:35.279812 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Openstack-System-Scope: None Sep 03 04:00:35.279812 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: User-Agent: python-urllib3/1.26.12 Sep 03 04:00:35.279812 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Auth-Token: gAAAAABjEtC_1ebsxjRVOwgkneWIx8Dwu2Q0W3ZocvBaFG6KWTBaNy6BfBf-DVcl7qmUnoeteuk-ITfA_OXnutEW1694UqHOBAYx-0arZ7KlehUSjxhVIzPfx8U3fuxOCmayhzYvtntGKmn6phRXtpRbVPO1tQ54x1TheOsy16Wq_aJuJ1ErBx4 Sep 03 04:00:35.279812 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Id: None Sep 03 04:00:35.279812 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Name: None Sep 03 04:00:35.279812 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Identity-Status: Confirmed Sep 03 04:00:35.279812 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Is-Admin-Project: True Sep 03 04:00:35.279812 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Id: default Sep 03 04:00:35.279812 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Name: Default Sep 03 04:00:35.279812 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Id: f40913ed988e4d3f8164fad43a6e8508 Sep 03 04:00:35.279812 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Name: tempest-TestVolumeBootPattern-130000365 Sep 03 04:00:35.279812 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Role: member,reader Sep 03 04:00:35.279812 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Roles: member,reader Sep 03 04:00:35.281610 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f40913ed988e4d3f8164fad43a6e8508"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f40913ed988e4d3f8164fad43a6e8508"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f40913ed988e4d3f8164fad43a6e8508"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f40913ed988e4d3f8164fad43a6e8508"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 04:00:35.281610 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant: tempest-TestVolumeBootPattern-130000365 Sep 03 04:00:35.281610 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Id: f40913ed988e4d3f8164fad43a6e8508 Sep 03 04:00:35.281610 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Name: tempest-TestVolumeBootPattern-130000365 Sep 03 04:00:35.281610 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User: tempest-TestVolumeBootPattern-130000365-project Sep 03 04:00:35.281610 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Id: default Sep 03 04:00:35.281610 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Name: Default Sep 03 04:00:35.281610 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Id: 1b4df8619fbc4d3bb4097fde33a400f7 Sep 03 04:00:35.281610 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Name: tempest-TestVolumeBootPattern-130000365-project Sep 03 04:00:35.281610 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: method: > Sep 03 04:00:35.281610 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: exception: Instance b6ffe18c-8f84-4388-a17a-60885c5f9f1c could not be found. Sep 03 04:00:35.281610 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: action_args: {'id': 'b6ffe18c-8f84-4388-a17a-60885c5f9f1c'} Sep 03 04:00:35.282577 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 04:00:35.282577 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 04:00:35.282577 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 04:00:35.282577 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 04:00:35.282577 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 04:00:35.282577 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 04:00:35.282577 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 04:00:35.282577 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 04:00:35.282577 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 04:00:35.282577 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 04:00:35.282577 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6ffe18c-8f84-4388-a17a-60885c5f9f1c could not be found. Sep 03 04:00:35.282577 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 04:00:35.282577 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 04:00:35.282577 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 04:00:35.282577 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 04:00:35.282577 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 04:00:35.282577 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 04:00:35.282577 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 04:00:35.282577 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 04:00:35.282577 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 04:00:35.284087 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 04:00:35.284087 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 04:00:35.284087 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 04:00:35.284087 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 04:00:35.284087 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 04:00:35.284087 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 04:00:35.284087 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 04:00:35.284087 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6ffe18c-8f84-4388-a17a-60885c5f9f1c could not be found. Sep 03 04:00:35.284087 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 04:00:35.284087 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 04:00:35.284087 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 04:00:35.284087 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 04:00:35.284087 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 04:00:35.284087 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 04:00:35.284087 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 04:00:35.284087 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 04:00:35.284087 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6ffe18c-8f84-4388-a17a-60885c5f9f1c could not be found. Sep 03 04:00:35.284087 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 04:00:35.285370 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-5d72764c-d8e7-4b03-ae88-d14a015bcbdf tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Returning 404 to user: Instance b6ffe18c-8f84-4388-a17a-60885c5f9f1c could not be found. {{(pid=132076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 04:00:35.285370 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-5d72764c-d8e7-4b03-ae88-d14a015bcbdf tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c" status: 404 len: 111 microversion: 2.1 time: 0.031132 Sep 03 04:00:35.285370 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 523/1062] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:00:35 2022] GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 04:00:35.385734 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-d07bf2fe-0251-449e-8f96-f08f1afd7a83 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-151988410", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-880761214", "security_groups": [{"name": "tempest-secgroup-smoke-1403213854"}], "block_device_mapping_v2": [{"uuid": "a68b3cfa-8c0f-4014-b5d1-bb667ce3e9ff", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "552aeadd-abdb-48a9-afc5-6c5bd1a9dd42"}]}} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 04:00:35.510754 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.network.neutron [None req-d07bf2fe-0251-449e-8f96-f08f1afd7a83 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] validate_networks() for [('552aeadd-abdb-48a9-afc5-6c5bd1a9dd42', None, None, None, None, None)] {{(pid=132077) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 04:00:36.017605 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-d07bf2fe-0251-449e-8f96-f08f1afd7a83 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Flavor limits 0:0:0 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 04:00:36.018021 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-d07bf2fe-0251-449e-8f96-f08f1afd7a83 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Image limits 0:0:0 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 04:00:36.018489 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-d07bf2fe-0251-449e-8f96-f08f1afd7a83 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Flavor pref 0:0:0 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 04:00:36.018913 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-d07bf2fe-0251-449e-8f96-f08f1afd7a83 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Image pref 0:0:0 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 04:00:36.019314 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-d07bf2fe-0251-449e-8f96-f08f1afd7a83 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 04:00:36.029287 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d07bf2fe-0251-449e-8f96-f08f1afd7a83 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:36.029776 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d07bf2fe-0251-449e-8f96-f08f1afd7a83 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:36.030205 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d07bf2fe-0251-449e-8f96-f08f1afd7a83 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:36.030962 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d07bf2fe-0251-449e-8f96-f08f1afd7a83 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:36.031413 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d07bf2fe-0251-449e-8f96-f08f1afd7a83 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:36.031838 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d07bf2fe-0251-449e-8f96-f08f1afd7a83 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:36.049312 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.quota [None req-d07bf2fe-0251-449e-8f96-f08f1afd7a83 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Getting quotas for project f40913ed988e4d3f8164fad43a6e8508. Resources: {'ram', 'instances', 'cores'} {{(pid=132077) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 04:00:36.053808 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.quota [None req-d07bf2fe-0251-449e-8f96-f08f1afd7a83 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Getting quotas for user 1b4df8619fbc4d3bb4097fde33a400f7 and project f40913ed988e4d3f8164fad43a6e8508. Resources: {'ram', 'instances', 'cores'} {{(pid=132077) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 04:00:36.114743 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-d07bf2fe-0251-449e-8f96-f08f1afd7a83 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Going to run 1 instances... {{(pid=132077) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 04:00:36.116932 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-d07bf2fe-0251-449e-8f96-f08f1afd7a83 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: d58279b4-98e4-4856-899b-fa2c9c397244] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a68b3cfa-8c0f-4014-b5d1-bb667ce3e9ff',volume_size=None,volume_type=None)] {{(pid=132077) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 04:00:36.249883 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-d07bf2fe-0251-449e-8f96-f08f1afd7a83 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.869064 Sep 03 04:00:36.256776 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 540/1063] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Sep 3 04:00:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 04:00:36.262091 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-7a6837b0-d16c-4bb8-b80a-fc1041b0d2df tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:00:36.262906 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-7a6837b0-d16c-4bb8-b80a-fc1041b0d2df tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: d58279b4-98e4-4856-899b-fa2c9c397244] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:00:36.318142 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-7a6837b0-d16c-4bb8-b80a-fc1041b0d2df tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:00:36.325308 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-7a6837b0-d16c-4bb8-b80a-fc1041b0d2df tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244" status: 200 len: 1093 microversion: 2.1 time: 0.067396 Sep 03 04:00:36.325839 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 524/1064] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:00:36 2022] GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244 => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 04:00:37.357407 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-19507e93-27c5-4ba9-8ac0-e57a1749b4d0 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:00:37.358053 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-19507e93-27c5-4ba9-8ac0-e57a1749b4d0 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: d58279b4-98e4-4856-899b-fa2c9c397244] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:00:37.412938 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-19507e93-27c5-4ba9-8ac0-e57a1749b4d0 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:00:37.420226 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-19507e93-27c5-4ba9-8ac0-e57a1749b4d0 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244" status: 200 len: 1093 microversion: 2.1 time: 0.067415 Sep 03 04:00:37.420762 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 541/1065] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:00:37 2022] GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244 => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:00:38.447596 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-18fe1612-0ba3-4b04-aa88-5c26d7a467c2 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:00:38.448519 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-18fe1612-0ba3-4b04-aa88-5c26d7a467c2 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: d58279b4-98e4-4856-899b-fa2c9c397244] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:00:38.521844 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-18fe1612-0ba3-4b04-aa88-5c26d7a467c2 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:00:38.529189 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-18fe1612-0ba3-4b04-aa88-5c26d7a467c2 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244" status: 200 len: 1093 microversion: 2.1 time: 0.088288 Sep 03 04:00:38.529713 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 525/1066] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:00:38 2022] GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244 => generated 1093 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:00:39.554479 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-f59a0c26-852c-47e4-8f0a-21dcb3249a6b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:00:39.555262 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-f59a0c26-852c-47e4-8f0a-21dcb3249a6b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: d58279b4-98e4-4856-899b-fa2c9c397244] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:00:39.609813 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-f59a0c26-852c-47e4-8f0a-21dcb3249a6b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:00:39.617239 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-f59a0c26-852c-47e4-8f0a-21dcb3249a6b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244" status: 200 len: 1093 microversion: 2.1 time: 0.068168 Sep 03 04:00:39.617833 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 542/1067] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:00:39 2022] GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244 => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:00:40.645156 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-77c6b7fa-5c12-4534-acfc-0bc11e4f035b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:00:40.646150 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-77c6b7fa-5c12-4534-acfc-0bc11e4f035b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: d58279b4-98e4-4856-899b-fa2c9c397244] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:00:40.657496 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-77c6b7fa-5c12-4534-acfc-0bc11e4f035b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:40.658312 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-77c6b7fa-5c12-4534-acfc-0bc11e4f035b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:40.659134 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-77c6b7fa-5c12-4534-acfc-0bc11e4f035b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:40.660281 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-77c6b7fa-5c12-4534-acfc-0bc11e4f035b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:40.661042 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-77c6b7fa-5c12-4534-acfc-0bc11e4f035b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:40.661738 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-77c6b7fa-5c12-4534-acfc-0bc11e4f035b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:40.724600 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-77c6b7fa-5c12-4534-acfc-0bc11e4f035b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:00:40.733095 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-77c6b7fa-5c12-4534-acfc-0bc11e4f035b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244" status: 200 len: 1143 microversion: 2.1 time: 0.095140 Sep 03 04:00:40.733654 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 526/1068] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:00:40 2022] GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244 => generated 1143 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:00:41.764427 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-4f8f6441-0fdc-44f7-a235-ce3c72e187f7 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:00:41.765026 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-4f8f6441-0fdc-44f7-a235-ce3c72e187f7 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: d58279b4-98e4-4856-899b-fa2c9c397244] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:00:41.773824 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4f8f6441-0fdc-44f7-a235-ce3c72e187f7 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:41.774357 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4f8f6441-0fdc-44f7-a235-ce3c72e187f7 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:41.774855 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4f8f6441-0fdc-44f7-a235-ce3c72e187f7 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:41.775765 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4f8f6441-0fdc-44f7-a235-ce3c72e187f7 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:41.776272 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4f8f6441-0fdc-44f7-a235-ce3c72e187f7 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:41.776739 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-4f8f6441-0fdc-44f7-a235-ce3c72e187f7 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:41.863570 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-4f8f6441-0fdc-44f7-a235-ce3c72e187f7 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:00:41.874032 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-4f8f6441-0fdc-44f7-a235-ce3c72e187f7 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244" status: 200 len: 1209 microversion: 2.1 time: 0.113698 Sep 03 04:00:41.875162 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 543/1069] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:00:41 2022] GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244 => generated 1209 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:00:42.738231 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-bb73cc88-f1c9-466e-ae3f-482f894b3d5b req-14352221-eecb-4ad9-95be-92b6d09b76d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d58279b4-98e4-4856-899b-fa2c9c397244", "tag": "e4e92cf0-9e6c-40a6-a76b-320356acf58e"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 04:00:42.751058 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-bb73cc88-f1c9-466e-ae3f-482f894b3d5b req-14352221-eecb-4ad9-95be-92b6d09b76d8 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:42.751507 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-bb73cc88-f1c9-466e-ae3f-482f894b3d5b req-14352221-eecb-4ad9-95be-92b6d09b76d8 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:42.752201 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-bb73cc88-f1c9-466e-ae3f-482f894b3d5b req-14352221-eecb-4ad9-95be-92b6d09b76d8 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:42.764421 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-bb73cc88-f1c9-466e-ae3f-482f894b3d5b req-14352221-eecb-4ad9-95be-92b6d09b76d8 service nova] Creating event network-changed:e4e92cf0-9e6c-40a6-a76b-320356acf58e for instance d58279b4-98e4-4856-899b-fa2c9c397244 on hv-cinder-79966 Sep 03 04:00:42.769623 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-bb73cc88-f1c9-466e-ae3f-482f894b3d5b req-14352221-eecb-4ad9-95be-92b6d09b76d8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035001 Sep 03 04:00:42.770234 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 527/1070] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 04:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 04:00:42.898121 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-67cbeab6-b200-4623-a3c2-3dab3522dd88 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:00:42.898824 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-67cbeab6-b200-4623-a3c2-3dab3522dd88 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: d58279b4-98e4-4856-899b-fa2c9c397244] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:00:42.906160 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-67cbeab6-b200-4623-a3c2-3dab3522dd88 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:42.906639 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-67cbeab6-b200-4623-a3c2-3dab3522dd88 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:42.907099 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-67cbeab6-b200-4623-a3c2-3dab3522dd88 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:42.907794 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-67cbeab6-b200-4623-a3c2-3dab3522dd88 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:42.908239 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-67cbeab6-b200-4623-a3c2-3dab3522dd88 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:42.908650 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-67cbeab6-b200-4623-a3c2-3dab3522dd88 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:43.040558 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-67cbeab6-b200-4623-a3c2-3dab3522dd88 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:00:43.048679 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-67cbeab6-b200-4623-a3c2-3dab3522dd88 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244" status: 200 len: 1265 microversion: 2.1 time: 0.154394 Sep 03 04:00:43.049483 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 544/1071] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:00:42 2022] GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:00:44.077057 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-d55f262d-e96b-4307-bc9c-7d596ac0e69b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:00:44.078065 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-d55f262d-e96b-4307-bc9c-7d596ac0e69b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: d58279b4-98e4-4856-899b-fa2c9c397244] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:00:44.088874 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d55f262d-e96b-4307-bc9c-7d596ac0e69b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:44.089356 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d55f262d-e96b-4307-bc9c-7d596ac0e69b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:44.089787 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d55f262d-e96b-4307-bc9c-7d596ac0e69b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:44.090484 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d55f262d-e96b-4307-bc9c-7d596ac0e69b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:44.090970 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d55f262d-e96b-4307-bc9c-7d596ac0e69b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:44.091389 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d55f262d-e96b-4307-bc9c-7d596ac0e69b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:44.226454 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-d55f262d-e96b-4307-bc9c-7d596ac0e69b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:00:44.234988 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-d55f262d-e96b-4307-bc9c-7d596ac0e69b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244" status: 200 len: 1265 microversion: 2.1 time: 0.165055 Sep 03 04:00:44.235587 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 528/1072] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:00:44 2022] GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:00:45.261563 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-8a06380e-8b8b-4ae7-bf40-de923f3544e6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:00:45.261563 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-8a06380e-8b8b-4ae7-bf40-de923f3544e6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: d58279b4-98e4-4856-899b-fa2c9c397244] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:00:45.268414 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8a06380e-8b8b-4ae7-bf40-de923f3544e6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:45.268899 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8a06380e-8b8b-4ae7-bf40-de923f3544e6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:45.269327 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8a06380e-8b8b-4ae7-bf40-de923f3544e6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:45.270025 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8a06380e-8b8b-4ae7-bf40-de923f3544e6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:45.270471 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8a06380e-8b8b-4ae7-bf40-de923f3544e6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:45.270935 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-8a06380e-8b8b-4ae7-bf40-de923f3544e6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:45.402534 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-8a06380e-8b8b-4ae7-bf40-de923f3544e6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:00:45.410367 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-8a06380e-8b8b-4ae7-bf40-de923f3544e6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244" status: 200 len: 1265 microversion: 2.1 time: 0.155570 Sep 03 04:00:45.410968 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 545/1073] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:00:45 2022] GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:00:46.437746 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-73d1d0bc-b47c-4448-9dcf-dfcc508319a3 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:00:46.438688 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-73d1d0bc-b47c-4448-9dcf-dfcc508319a3 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: d58279b4-98e4-4856-899b-fa2c9c397244] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:00:46.449636 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-73d1d0bc-b47c-4448-9dcf-dfcc508319a3 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:46.450440 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-73d1d0bc-b47c-4448-9dcf-dfcc508319a3 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:46.451215 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-73d1d0bc-b47c-4448-9dcf-dfcc508319a3 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:46.452349 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-73d1d0bc-b47c-4448-9dcf-dfcc508319a3 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:46.453097 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-73d1d0bc-b47c-4448-9dcf-dfcc508319a3 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:46.453823 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-73d1d0bc-b47c-4448-9dcf-dfcc508319a3 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:46.598633 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-73d1d0bc-b47c-4448-9dcf-dfcc508319a3 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:00:46.608563 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-73d1d0bc-b47c-4448-9dcf-dfcc508319a3 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244" status: 200 len: 1265 microversion: 2.1 time: 0.177442 Sep 03 04:00:46.609126 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 529/1074] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:00:46 2022] GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:00:47.634653 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-218cc84c-a66e-4f21-b5c6-89cb46c61937 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:00:47.635632 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-218cc84c-a66e-4f21-b5c6-89cb46c61937 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: d58279b4-98e4-4856-899b-fa2c9c397244] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:00:47.637763 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell0:SELECT=2 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:47.644467 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-218cc84c-a66e-4f21-b5c6-89cb46c61937 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:47.644997 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-218cc84c-a66e-4f21-b5c6-89cb46c61937 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:47.645474 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-218cc84c-a66e-4f21-b5c6-89cb46c61937 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:47.646237 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-218cc84c-a66e-4f21-b5c6-89cb46c61937 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:47.646742 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-218cc84c-a66e-4f21-b5c6-89cb46c61937 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:47.647234 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-218cc84c-a66e-4f21-b5c6-89cb46c61937 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:47.788032 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-218cc84c-a66e-4f21-b5c6-89cb46c61937 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:00:47.796488 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-218cc84c-a66e-4f21-b5c6-89cb46c61937 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244" status: 200 len: 1265 microversion: 2.1 time: 0.168335 Sep 03 04:00:47.797096 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 546/1075] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:00:47 2022] GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:00:48.824327 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-5e1e43c5-50a5-4086-aaea-fe9a5d85aab0 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:00:48.825219 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-5e1e43c5-50a5-4086-aaea-fe9a5d85aab0 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: d58279b4-98e4-4856-899b-fa2c9c397244] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:00:48.829694 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell0:SELECT=4 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:48.839638 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5e1e43c5-50a5-4086-aaea-fe9a5d85aab0 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:48.840404 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5e1e43c5-50a5-4086-aaea-fe9a5d85aab0 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:48.841106 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5e1e43c5-50a5-4086-aaea-fe9a5d85aab0 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:48.842235 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5e1e43c5-50a5-4086-aaea-fe9a5d85aab0 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:48.843097 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5e1e43c5-50a5-4086-aaea-fe9a5d85aab0 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:48.843787 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5e1e43c5-50a5-4086-aaea-fe9a5d85aab0 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:48.987580 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-5e1e43c5-50a5-4086-aaea-fe9a5d85aab0 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:00:48.995776 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-5e1e43c5-50a5-4086-aaea-fe9a5d85aab0 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244" status: 200 len: 1265 microversion: 2.1 time: 0.178553 Sep 03 04:00:48.996322 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 530/1076] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:00:48 2022] GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:00:50.022965 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-e6fd4711-26ff-42f6-aed5-4a7438035a50 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:00:50.023804 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-e6fd4711-26ff-42f6-aed5-4a7438035a50 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: d58279b4-98e4-4856-899b-fa2c9c397244] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:00:50.027454 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell0:SELECT=10 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:50.036513 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e6fd4711-26ff-42f6-aed5-4a7438035a50 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:50.037300 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e6fd4711-26ff-42f6-aed5-4a7438035a50 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:50.038001 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e6fd4711-26ff-42f6-aed5-4a7438035a50 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:50.039187 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e6fd4711-26ff-42f6-aed5-4a7438035a50 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:50.039927 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e6fd4711-26ff-42f6-aed5-4a7438035a50 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:50.040622 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-e6fd4711-26ff-42f6-aed5-4a7438035a50 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:50.179323 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-e6fd4711-26ff-42f6-aed5-4a7438035a50 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:00:50.187602 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-e6fd4711-26ff-42f6-aed5-4a7438035a50 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244" status: 200 len: 1265 microversion: 2.1 time: 0.171296 Sep 03 04:00:50.188406 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 547/1077] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:00:50 2022] GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:00:51.214532 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-80071749-c404-4d25-aed9-90511c158bf5 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:00:51.215199 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-80071749-c404-4d25-aed9-90511c158bf5 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: d58279b4-98e4-4856-899b-fa2c9c397244] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:00:51.222900 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-80071749-c404-4d25-aed9-90511c158bf5 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:51.223469 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-80071749-c404-4d25-aed9-90511c158bf5 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:51.223975 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-80071749-c404-4d25-aed9-90511c158bf5 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:51.224795 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-80071749-c404-4d25-aed9-90511c158bf5 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:51.225322 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-80071749-c404-4d25-aed9-90511c158bf5 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:51.225814 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-80071749-c404-4d25-aed9-90511c158bf5 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:51.364100 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-80071749-c404-4d25-aed9-90511c158bf5 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:00:51.375862 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-80071749-c404-4d25-aed9-90511c158bf5 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244" status: 200 len: 1265 microversion: 2.1 time: 0.167576 Sep 03 04:00:51.376641 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 531/1078] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:00:51 2022] GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:00:52.399278 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-7db18186-848e-4479-a451-31ab4da3782e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:00:52.399945 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-7db18186-848e-4479-a451-31ab4da3782e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: d58279b4-98e4-4856-899b-fa2c9c397244] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:00:52.412858 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7db18186-848e-4479-a451-31ab4da3782e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:52.413479 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7db18186-848e-4479-a451-31ab4da3782e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:52.413920 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7db18186-848e-4479-a451-31ab4da3782e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:52.414622 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7db18186-848e-4479-a451-31ab4da3782e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:52.415107 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7db18186-848e-4479-a451-31ab4da3782e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:52.415511 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7db18186-848e-4479-a451-31ab4da3782e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:52.557638 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-7db18186-848e-4479-a451-31ab4da3782e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:00:52.566218 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-7db18186-848e-4479-a451-31ab4da3782e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244" status: 200 len: 1265 microversion: 2.1 time: 0.170898 Sep 03 04:00:52.567021 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 548/1079] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:00:52 2022] GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:00:52.646228 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-fbbccde7-f8d9-4c2c-bc03-c21c9874c887 req-d3d4a13c-461c-4097-8cc2-2b2509ad69b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d58279b4-98e4-4856-899b-fa2c9c397244", "name": "network-vif-plugged", "status": "completed", "tag": "e4e92cf0-9e6c-40a6-a76b-320356acf58e"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 04:00:52.656354 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-fbbccde7-f8d9-4c2c-bc03-c21c9874c887 req-d3d4a13c-461c-4097-8cc2-2b2509ad69b9 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:52.656819 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-fbbccde7-f8d9-4c2c-bc03-c21c9874c887 req-d3d4a13c-461c-4097-8cc2-2b2509ad69b9 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:52.657239 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-fbbccde7-f8d9-4c2c-bc03-c21c9874c887 req-d3d4a13c-461c-4097-8cc2-2b2509ad69b9 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:52.668450 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-fbbccde7-f8d9-4c2c-bc03-c21c9874c887 req-d3d4a13c-461c-4097-8cc2-2b2509ad69b9 service nova] Creating event network-vif-plugged:e4e92cf0-9e6c-40a6-a76b-320356acf58e for instance d58279b4-98e4-4856-899b-fa2c9c397244 on hv-cinder-79966 Sep 03 04:00:52.673784 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-fbbccde7-f8d9-4c2c-bc03-c21c9874c887 req-d3d4a13c-461c-4097-8cc2-2b2509ad69b9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158358 Sep 03 04:00:52.674354 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 532/1080] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 04:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 04:00:53.593553 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-9c04877c-3c61-4916-9bd4-262017959213 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:00:53.594178 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-9c04877c-3c61-4916-9bd4-262017959213 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: d58279b4-98e4-4856-899b-fa2c9c397244] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:00:53.601866 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9c04877c-3c61-4916-9bd4-262017959213 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:53.602407 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9c04877c-3c61-4916-9bd4-262017959213 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:53.602936 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9c04877c-3c61-4916-9bd4-262017959213 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:53.604032 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9c04877c-3c61-4916-9bd4-262017959213 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:53.604534 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9c04877c-3c61-4916-9bd4-262017959213 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:53.605009 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9c04877c-3c61-4916-9bd4-262017959213 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:53.736550 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-9c04877c-3c61-4916-9bd4-262017959213 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:00:53.744947 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-9c04877c-3c61-4916-9bd4-262017959213 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244" status: 200 len: 1265 microversion: 2.1 time: 0.158566 Sep 03 04:00:53.745627 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 549/1081] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:00:53 2022] GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:00:54.769331 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-20739df7-ef6e-42a4-843c-cf911b7bf09b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:00:54.769969 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-20739df7-ef6e-42a4-843c-cf911b7bf09b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: d58279b4-98e4-4856-899b-fa2c9c397244] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:00:54.777016 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-20739df7-ef6e-42a4-843c-cf911b7bf09b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:54.777486 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-20739df7-ef6e-42a4-843c-cf911b7bf09b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:54.777922 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-20739df7-ef6e-42a4-843c-cf911b7bf09b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:54.778604 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-20739df7-ef6e-42a4-843c-cf911b7bf09b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:54.779104 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-20739df7-ef6e-42a4-843c-cf911b7bf09b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:54.779521 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-20739df7-ef6e-42a4-843c-cf911b7bf09b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:54.924648 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-20739df7-ef6e-42a4-843c-cf911b7bf09b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:00:54.932680 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-20739df7-ef6e-42a4-843c-cf911b7bf09b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244" status: 200 len: 1452 microversion: 2.1 time: 0.168127 Sep 03 04:00:54.933213 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 533/1082] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:00:54 2022] GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244 => generated 1452 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:00:54.955073 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-44845cc7-4baf-4cf8-8859-b62182f489f3 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:00:54.955669 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-44845cc7-4baf-4cf8-8859-b62182f489f3 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: d58279b4-98e4-4856-899b-fa2c9c397244] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:00:54.962090 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-44845cc7-4baf-4cf8-8859-b62182f489f3 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:54.962565 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-44845cc7-4baf-4cf8-8859-b62182f489f3 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:54.963021 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-44845cc7-4baf-4cf8-8859-b62182f489f3 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:54.963704 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-44845cc7-4baf-4cf8-8859-b62182f489f3 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:54.964188 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-44845cc7-4baf-4cf8-8859-b62182f489f3 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:54.964595 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-44845cc7-4baf-4cf8-8859-b62182f489f3 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:55.099749 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-44845cc7-4baf-4cf8-8859-b62182f489f3 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:00:55.111446 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-44845cc7-4baf-4cf8-8859-b62182f489f3 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244" status: 200 len: 1452 microversion: 2.1 time: 0.160268 Sep 03 04:00:55.112031 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 550/1083] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:00:54 2022] GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244 => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:00:56.946776 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-c9cbcbe1-abfc-4cd9-908c-0605f644ee4b req-0a036265-fd6f-4060-90de-bc5e894c5168 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d58279b4-98e4-4856-899b-fa2c9c397244", "tag": "e4e92cf0-9e6c-40a6-a76b-320356acf58e"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 04:00:56.956840 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-c9cbcbe1-abfc-4cd9-908c-0605f644ee4b req-0a036265-fd6f-4060-90de-bc5e894c5168 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:00:56.957311 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-c9cbcbe1-abfc-4cd9-908c-0605f644ee4b req-0a036265-fd6f-4060-90de-bc5e894c5168 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:00:56.957725 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-c9cbcbe1-abfc-4cd9-908c-0605f644ee4b req-0a036265-fd6f-4060-90de-bc5e894c5168 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:00:56.968700 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-c9cbcbe1-abfc-4cd9-908c-0605f644ee4b req-0a036265-fd6f-4060-90de-bc5e894c5168 service nova] Creating event network-changed:e4e92cf0-9e6c-40a6-a76b-320356acf58e for instance d58279b4-98e4-4856-899b-fa2c9c397244 on hv-cinder-79966 Sep 03 04:00:56.973473 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-c9cbcbe1-abfc-4cd9-908c-0605f644ee4b req-0a036265-fd6f-4060-90de-bc5e894c5168 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030687 Sep 03 04:00:56.974069 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 534/1084] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 04:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 04:02:34.125236 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:02:34.126026 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:02:34.127102 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 03 04:02:34.127268 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Sat Sep 3 04:02:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Sep 03 04:02:34.132448 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-7e0f596f-e100-474e-aa6b-42f9de9871d8 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-757274310", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-880761214", "security_groups": [{"name": "tempest-secgroup-smoke-1403213854"}], "block_device_mapping_v2": [{"uuid": "776e0432-1a5a-4044-be65-5f3a7cc50e2b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "552aeadd-abdb-48a9-afc5-6c5bd1a9dd42"}]}} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 04:02:34.261719 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.network.neutron [None req-7e0f596f-e100-474e-aa6b-42f9de9871d8 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] validate_networks() for [('552aeadd-abdb-48a9-afc5-6c5bd1a9dd42', None, None, None, None, None)] {{(pid=132077) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 04:02:34.660734 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-7e0f596f-e100-474e-aa6b-42f9de9871d8 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Flavor limits 0:0:0 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 04:02:34.661153 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-7e0f596f-e100-474e-aa6b-42f9de9871d8 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Image limits 0:0:0 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 04:02:34.661620 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-7e0f596f-e100-474e-aa6b-42f9de9871d8 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Flavor pref 0:0:0 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 04:02:34.662020 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-7e0f596f-e100-474e-aa6b-42f9de9871d8 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Image pref 0:0:0 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 04:02:34.662453 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.virt.hardware [None req-7e0f596f-e100-474e-aa6b-42f9de9871d8 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 04:02:34.671922 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7e0f596f-e100-474e-aa6b-42f9de9871d8 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:02:34.672511 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7e0f596f-e100-474e-aa6b-42f9de9871d8 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:02:34.672948 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7e0f596f-e100-474e-aa6b-42f9de9871d8 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:02:34.673675 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7e0f596f-e100-474e-aa6b-42f9de9871d8 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:02:34.674127 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7e0f596f-e100-474e-aa6b-42f9de9871d8 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:02:34.674546 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7e0f596f-e100-474e-aa6b-42f9de9871d8 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:02:34.691661 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.quota [None req-7e0f596f-e100-474e-aa6b-42f9de9871d8 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Getting quotas for project f40913ed988e4d3f8164fad43a6e8508. Resources: {'ram', 'instances', 'cores'} {{(pid=132077) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 04:02:34.695616 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.quota [None req-7e0f596f-e100-474e-aa6b-42f9de9871d8 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Getting quotas for user 1b4df8619fbc4d3bb4097fde33a400f7 and project f40913ed988e4d3f8164fad43a6e8508. Resources: {'ram', 'instances', 'cores'} {{(pid=132077) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 04:02:34.755578 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-7e0f596f-e100-474e-aa6b-42f9de9871d8 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Going to run 1 instances... {{(pid=132077) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 04:02:34.758027 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-7e0f596f-e100-474e-aa6b-42f9de9871d8 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: 0de50a90-4ba6-4c56-b0d0-5ba8b17479bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='776e0432-1a5a-4044-be65-5f3a7cc50e2b',volume_size=None,volume_type=None)] {{(pid=132077) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 04:02:34.894903 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-7e0f596f-e100-474e-aa6b-42f9de9871d8 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.771363 Sep 03 04:02:34.895548 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 551/1085] 10.222.0.25 () {60 vars in 1147 bytes} [Sat Sep 3 04:02:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 04:02:34.905376 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_api:SELECT=32 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:02:34.906134 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell1:SELECT=52 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:02:34.907196 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 03 04:02:34.907348 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Sat Sep 3 04:02:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd (ip 10.222.0.25) !!! Sep 03 04:02:34.908705 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 03 04:02:34.908838 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Sat Sep 3 04:02:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd (ip 10.222.0.25) !!! Sep 03 04:02:34.921411 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-d0a3d563-339f-4840-a38b-23efad7ef0d9 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:02:34.922569 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-d0a3d563-339f-4840-a38b-23efad7ef0d9 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: 0de50a90-4ba6-4c56-b0d0-5ba8b17479bd] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:02:34.984481 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-d0a3d563-339f-4840-a38b-23efad7ef0d9 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:02:34.991823 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-d0a3d563-339f-4840-a38b-23efad7ef0d9 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd" status: 200 len: 1093 microversion: 2.1 time: 0.088574 Sep 03 04:02:34.992388 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 535/1086] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:02:34 2022] GET /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd => generated 1093 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:02:36.015751 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-9c042cc8-2806-4668-875c-68f46ddc00e7 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:02:36.016368 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-9c042cc8-2806-4668-875c-68f46ddc00e7 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: 0de50a90-4ba6-4c56-b0d0-5ba8b17479bd] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:02:36.023383 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9c042cc8-2806-4668-875c-68f46ddc00e7 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:02:36.023877 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9c042cc8-2806-4668-875c-68f46ddc00e7 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:02:36.024313 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9c042cc8-2806-4668-875c-68f46ddc00e7 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:02:36.025020 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9c042cc8-2806-4668-875c-68f46ddc00e7 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:02:36.025499 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9c042cc8-2806-4668-875c-68f46ddc00e7 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:02:36.026139 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-9c042cc8-2806-4668-875c-68f46ddc00e7 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:02:36.092844 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-9c042cc8-2806-4668-875c-68f46ddc00e7 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:02:36.101715 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-9c042cc8-2806-4668-875c-68f46ddc00e7 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd" status: 200 len: 1209 microversion: 2.1 time: 0.090772 Sep 03 04:02:36.102856 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 552/1087] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:02:36 2022] GET /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd => generated 1209 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:02:37.127295 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-749e43b2-9bcd-4de4-8d68-4f1e396b3f1e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:02:37.128271 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-749e43b2-9bcd-4de4-8d68-4f1e396b3f1e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: 0de50a90-4ba6-4c56-b0d0-5ba8b17479bd] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:02:37.135420 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-749e43b2-9bcd-4de4-8d68-4f1e396b3f1e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:02:37.135896 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-749e43b2-9bcd-4de4-8d68-4f1e396b3f1e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:02:37.136323 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-749e43b2-9bcd-4de4-8d68-4f1e396b3f1e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:02:37.137011 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-749e43b2-9bcd-4de4-8d68-4f1e396b3f1e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:02:37.137826 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-749e43b2-9bcd-4de4-8d68-4f1e396b3f1e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:02:37.138925 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-749e43b2-9bcd-4de4-8d68-4f1e396b3f1e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:02:37.334037 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-749e43b2-9bcd-4de4-8d68-4f1e396b3f1e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:02:37.342570 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-749e43b2-9bcd-4de4-8d68-4f1e396b3f1e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd" status: 200 len: 1265 microversion: 2.1 time: 0.219495 Sep 03 04:02:37.343184 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 536/1088] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:02:37 2022] GET /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:02:37.354225 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [req-ffd90a08-8045-4d1e-8fa2-fd14fc5fa388 req-69aed048-bf78-4e71-aef9-e391d0b29fcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0de50a90-4ba6-4c56-b0d0-5ba8b17479bd", "tag": "0426987e-8896-40d4-862e-044635ac1fa0"}]} {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 04:02:37.370517 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-ffd90a08-8045-4d1e-8fa2-fd14fc5fa388 req-69aed048-bf78-4e71-aef9-e391d0b29fcd service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:02:37.371337 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-ffd90a08-8045-4d1e-8fa2-fd14fc5fa388 req-69aed048-bf78-4e71-aef9-e391d0b29fcd service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:02:37.371776 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [req-ffd90a08-8045-4d1e-8fa2-fd14fc5fa388 req-69aed048-bf78-4e71-aef9-e391d0b29fcd service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:02:37.384237 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.compute.server_external_events [req-ffd90a08-8045-4d1e-8fa2-fd14fc5fa388 req-69aed048-bf78-4e71-aef9-e391d0b29fcd service nova] Creating event network-changed:0426987e-8896-40d4-862e-044635ac1fa0 for instance 0de50a90-4ba6-4c56-b0d0-5ba8b17479bd on hv-cinder-79966 Sep 03 04:02:37.390058 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [req-ffd90a08-8045-4d1e-8fa2-fd14fc5fa388 req-69aed048-bf78-4e71-aef9-e391d0b29fcd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039917 Sep 03 04:02:37.390672 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 553/1089] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 04:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 04:02:38.366255 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-f3a8007f-9f87-4f47-8a29-e4abb228b680 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:02:38.367022 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-f3a8007f-9f87-4f47-8a29-e4abb228b680 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: 0de50a90-4ba6-4c56-b0d0-5ba8b17479bd] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:02:38.373435 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f3a8007f-9f87-4f47-8a29-e4abb228b680 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:02:38.373917 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f3a8007f-9f87-4f47-8a29-e4abb228b680 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:02:38.374342 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f3a8007f-9f87-4f47-8a29-e4abb228b680 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:02:38.375302 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f3a8007f-9f87-4f47-8a29-e4abb228b680 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:02:38.375748 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f3a8007f-9f87-4f47-8a29-e4abb228b680 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:02:38.376162 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-f3a8007f-9f87-4f47-8a29-e4abb228b680 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:02:38.576921 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-f3a8007f-9f87-4f47-8a29-e4abb228b680 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:02:38.585164 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-f3a8007f-9f87-4f47-8a29-e4abb228b680 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd" status: 200 len: 1265 microversion: 2.1 time: 0.223034 Sep 03 04:02:38.594759 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 537/1090] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:02:38 2022] GET /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd => generated 1265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:02:39.615014 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-671af2fd-c71a-49b8-9ae6-83ed586a4c1d tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:02:39.616052 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-671af2fd-c71a-49b8-9ae6-83ed586a4c1d tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: 0de50a90-4ba6-4c56-b0d0-5ba8b17479bd] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:02:39.626857 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-671af2fd-c71a-49b8-9ae6-83ed586a4c1d tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:02:39.627685 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-671af2fd-c71a-49b8-9ae6-83ed586a4c1d tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:02:39.628403 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-671af2fd-c71a-49b8-9ae6-83ed586a4c1d tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:02:39.629551 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-671af2fd-c71a-49b8-9ae6-83ed586a4c1d tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:02:39.630306 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-671af2fd-c71a-49b8-9ae6-83ed586a4c1d tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:02:39.631055 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-671af2fd-c71a-49b8-9ae6-83ed586a4c1d tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:02:39.766053 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-671af2fd-c71a-49b8-9ae6-83ed586a4c1d tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:02:39.777497 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-671af2fd-c71a-49b8-9ae6-83ed586a4c1d tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd" status: 200 len: 1265 microversion: 2.1 time: 0.170857 Sep 03 04:02:39.778258 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 554/1091] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:02:39 2022] GET /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:02:40.808643 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-d196f487-aa3c-4261-bfb9-b09e8feff590 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:02:40.809689 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-d196f487-aa3c-4261-bfb9-b09e8feff590 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: 0de50a90-4ba6-4c56-b0d0-5ba8b17479bd] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:02:40.821586 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d196f487-aa3c-4261-bfb9-b09e8feff590 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:02:40.822383 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d196f487-aa3c-4261-bfb9-b09e8feff590 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:02:40.823157 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d196f487-aa3c-4261-bfb9-b09e8feff590 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:02:40.824310 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d196f487-aa3c-4261-bfb9-b09e8feff590 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:02:40.825061 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d196f487-aa3c-4261-bfb9-b09e8feff590 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:02:40.825766 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d196f487-aa3c-4261-bfb9-b09e8feff590 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:02:40.978251 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-d196f487-aa3c-4261-bfb9-b09e8feff590 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:02:40.986789 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-d196f487-aa3c-4261-bfb9-b09e8feff590 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd" status: 200 len: 1265 microversion: 2.1 time: 0.184747 Sep 03 04:02:40.987407 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 538/1092] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:02:40 2022] GET /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:02:42.014138 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-ea682b30-1105-4766-bbbb-6263111fa636 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:02:42.015132 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-ea682b30-1105-4766-bbbb-6263111fa636 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: 0de50a90-4ba6-4c56-b0d0-5ba8b17479bd] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:02:42.026022 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ea682b30-1105-4766-bbbb-6263111fa636 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:02:42.026507 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ea682b30-1105-4766-bbbb-6263111fa636 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:02:42.026975 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ea682b30-1105-4766-bbbb-6263111fa636 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:02:42.027682 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ea682b30-1105-4766-bbbb-6263111fa636 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:02:42.028132 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ea682b30-1105-4766-bbbb-6263111fa636 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:02:42.028554 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-ea682b30-1105-4766-bbbb-6263111fa636 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:02:42.171311 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-ea682b30-1105-4766-bbbb-6263111fa636 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:02:42.179536 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-ea682b30-1105-4766-bbbb-6263111fa636 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd" status: 200 len: 1265 microversion: 2.1 time: 0.171946 Sep 03 04:02:42.180088 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 555/1093] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:02:42 2022] GET /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:02:43.207014 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-a552c664-c4e1-4fd1-ba23-dff2596e3eda tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:02:43.207941 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-a552c664-c4e1-4fd1-ba23-dff2596e3eda tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: 0de50a90-4ba6-4c56-b0d0-5ba8b17479bd] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:02:43.219056 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a552c664-c4e1-4fd1-ba23-dff2596e3eda tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:02:43.219845 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a552c664-c4e1-4fd1-ba23-dff2596e3eda tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:02:43.220555 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a552c664-c4e1-4fd1-ba23-dff2596e3eda tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:02:43.221698 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a552c664-c4e1-4fd1-ba23-dff2596e3eda tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:02:43.222432 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a552c664-c4e1-4fd1-ba23-dff2596e3eda tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:02:43.223174 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-a552c664-c4e1-4fd1-ba23-dff2596e3eda tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:02:43.360084 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-a552c664-c4e1-4fd1-ba23-dff2596e3eda tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:02:43.372423 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-a552c664-c4e1-4fd1-ba23-dff2596e3eda tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd" status: 200 len: 1265 microversion: 2.1 time: 0.171677 Sep 03 04:02:43.373134 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 539/1094] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:02:43 2022] GET /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:02:44.403831 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-7a7b11e5-0988-4bdc-af31-ad3a6471f834 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:02:44.404451 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-7a7b11e5-0988-4bdc-af31-ad3a6471f834 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: 0de50a90-4ba6-4c56-b0d0-5ba8b17479bd] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:02:44.413985 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7a7b11e5-0988-4bdc-af31-ad3a6471f834 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:02:44.414763 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7a7b11e5-0988-4bdc-af31-ad3a6471f834 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:02:44.415529 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7a7b11e5-0988-4bdc-af31-ad3a6471f834 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:02:44.416675 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7a7b11e5-0988-4bdc-af31-ad3a6471f834 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:02:44.417363 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7a7b11e5-0988-4bdc-af31-ad3a6471f834 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:02:44.418029 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-7a7b11e5-0988-4bdc-af31-ad3a6471f834 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:02:44.565131 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-7a7b11e5-0988-4bdc-af31-ad3a6471f834 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:02:44.573769 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-7a7b11e5-0988-4bdc-af31-ad3a6471f834 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd" status: 200 len: 1265 microversion: 2.1 time: 0.176415 Sep 03 04:02:44.574346 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 556/1095] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:02:44 2022] GET /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:02:45.597651 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-eba9376d-e44d-434c-998e-a5d7bb325d17 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:02:45.598276 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-eba9376d-e44d-434c-998e-a5d7bb325d17 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: 0de50a90-4ba6-4c56-b0d0-5ba8b17479bd] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:02:45.600739 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell0:SELECT=2 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:02:45.607118 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-eba9376d-e44d-434c-998e-a5d7bb325d17 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:02:45.607388 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-eba9376d-e44d-434c-998e-a5d7bb325d17 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:02:45.607895 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-eba9376d-e44d-434c-998e-a5d7bb325d17 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:02:45.608619 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-eba9376d-e44d-434c-998e-a5d7bb325d17 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:02:45.608979 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-eba9376d-e44d-434c-998e-a5d7bb325d17 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:02:45.609401 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-eba9376d-e44d-434c-998e-a5d7bb325d17 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:02:45.749999 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-eba9376d-e44d-434c-998e-a5d7bb325d17 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:02:45.765064 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-eba9376d-e44d-434c-998e-a5d7bb325d17 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd" status: 200 len: 1265 microversion: 2.1 time: 0.171174 Sep 03 04:02:45.765935 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 540/1096] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:02:45 2022] GET /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:02:46.797172 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-a6a9deb2-9771-4703-862e-f61b218f424c tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:02:46.797749 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-a6a9deb2-9771-4703-862e-f61b218f424c tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: 0de50a90-4ba6-4c56-b0d0-5ba8b17479bd] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:02:46.799764 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell0:SELECT=2 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:02:46.800440 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell0:SELECT=6 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:02:46.807550 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a6a9deb2-9771-4703-862e-f61b218f424c tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:02:46.808344 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a6a9deb2-9771-4703-862e-f61b218f424c tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:02:46.808917 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a6a9deb2-9771-4703-862e-f61b218f424c tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:02:46.809942 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a6a9deb2-9771-4703-862e-f61b218f424c tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:02:46.810437 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a6a9deb2-9771-4703-862e-f61b218f424c tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:02:46.814649 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a6a9deb2-9771-4703-862e-f61b218f424c tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:02:46.958302 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a6a9deb2-9771-4703-862e-f61b218f424c tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:02:46.970773 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-a6a9deb2-9771-4703-862e-f61b218f424c tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd" status: 200 len: 1265 microversion: 2.1 time: 0.179765 Sep 03 04:02:46.971667 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 557/1097] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:02:46 2022] GET /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:02:47.158218 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-aa8a487c-b4ae-48b0-808c-ce3dfd59e6c0 req-dc5f4fa1-7a17-414d-bc54-925c86883d6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0de50a90-4ba6-4c56-b0d0-5ba8b17479bd", "name": "network-vif-plugged", "status": "completed", "tag": "0426987e-8896-40d4-862e-044635ac1fa0"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 04:02:47.174327 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-aa8a487c-b4ae-48b0-808c-ce3dfd59e6c0 req-dc5f4fa1-7a17-414d-bc54-925c86883d6b service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:02:47.175116 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-aa8a487c-b4ae-48b0-808c-ce3dfd59e6c0 req-dc5f4fa1-7a17-414d-bc54-925c86883d6b service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:02:47.175830 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-aa8a487c-b4ae-48b0-808c-ce3dfd59e6c0 req-dc5f4fa1-7a17-414d-bc54-925c86883d6b service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:02:47.191142 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-aa8a487c-b4ae-48b0-808c-ce3dfd59e6c0 req-dc5f4fa1-7a17-414d-bc54-925c86883d6b service nova] Creating event network-vif-plugged:0426987e-8896-40d4-862e-044635ac1fa0 for instance 0de50a90-4ba6-4c56-b0d0-5ba8b17479bd on hv-cinder-79966 Sep 03 04:02:47.196266 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-aa8a487c-b4ae-48b0-808c-ce3dfd59e6c0 req-dc5f4fa1-7a17-414d-bc54-925c86883d6b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042710 Sep 03 04:02:47.197035 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 541/1098] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 04:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 04:02:48.003839 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-60dc5483-64c1-4e13-b3da-b09bf2baf6e6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:02:48.004804 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-60dc5483-64c1-4e13-b3da-b09bf2baf6e6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: 0de50a90-4ba6-4c56-b0d0-5ba8b17479bd] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:02:48.016089 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-60dc5483-64c1-4e13-b3da-b09bf2baf6e6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:02:48.016878 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-60dc5483-64c1-4e13-b3da-b09bf2baf6e6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:02:48.017591 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-60dc5483-64c1-4e13-b3da-b09bf2baf6e6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:02:48.018716 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-60dc5483-64c1-4e13-b3da-b09bf2baf6e6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:02:48.019495 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-60dc5483-64c1-4e13-b3da-b09bf2baf6e6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:02:48.020187 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-60dc5483-64c1-4e13-b3da-b09bf2baf6e6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:02:48.164400 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-60dc5483-64c1-4e13-b3da-b09bf2baf6e6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:02:48.181726 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-60dc5483-64c1-4e13-b3da-b09bf2baf6e6 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd" status: 200 len: 1265 microversion: 2.1 time: 0.184418 Sep 03 04:02:48.182490 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 558/1099] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:02:47 2022] GET /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:02:49.211234 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-d8eafcfc-29f8-4733-aa71-271f5a8b3a95 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:02:49.212437 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-d8eafcfc-29f8-4733-aa71-271f5a8b3a95 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: 0de50a90-4ba6-4c56-b0d0-5ba8b17479bd] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:02:49.222775 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d8eafcfc-29f8-4733-aa71-271f5a8b3a95 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:02:49.223632 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d8eafcfc-29f8-4733-aa71-271f5a8b3a95 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:02:49.224354 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d8eafcfc-29f8-4733-aa71-271f5a8b3a95 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:02:49.225496 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d8eafcfc-29f8-4733-aa71-271f5a8b3a95 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:02:49.226252 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d8eafcfc-29f8-4733-aa71-271f5a8b3a95 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:02:49.226997 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d8eafcfc-29f8-4733-aa71-271f5a8b3a95 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:02:49.362315 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-d8eafcfc-29f8-4733-aa71-271f5a8b3a95 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:02:49.372088 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-d8eafcfc-29f8-4733-aa71-271f5a8b3a95 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd" status: 200 len: 1451 microversion: 2.1 time: 0.168701 Sep 03 04:02:49.372659 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 542/1100] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:02:49 2022] GET /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd => generated 1451 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:02:49.394351 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-a532514b-cfe2-4f7a-9ba4-847382eb1774 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:02:49.394964 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-a532514b-cfe2-4f7a-9ba4-847382eb1774 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: 0de50a90-4ba6-4c56-b0d0-5ba8b17479bd] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:02:49.401537 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a532514b-cfe2-4f7a-9ba4-847382eb1774 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:02:49.402004 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a532514b-cfe2-4f7a-9ba4-847382eb1774 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:02:49.402431 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a532514b-cfe2-4f7a-9ba4-847382eb1774 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:02:49.403154 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a532514b-cfe2-4f7a-9ba4-847382eb1774 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:02:49.403602 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a532514b-cfe2-4f7a-9ba4-847382eb1774 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:02:49.404018 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-a532514b-cfe2-4f7a-9ba4-847382eb1774 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:02:49.558605 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-a532514b-cfe2-4f7a-9ba4-847382eb1774 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:02:49.567349 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-a532514b-cfe2-4f7a-9ba4-847382eb1774 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd" status: 200 len: 1451 microversion: 2.1 time: 0.176814 Sep 03 04:02:49.567912 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 559/1101] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:02:49 2022] GET /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd => generated 1451 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 04:02:51.275817 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-e9943941-be52-4085-b4f3-fd75984d9e33 req-31a1db55-d69c-4664-a530-89b7330cb29c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0de50a90-4ba6-4c56-b0d0-5ba8b17479bd", "tag": "0426987e-8896-40d4-862e-044635ac1fa0"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 04:02:51.286044 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-e9943941-be52-4085-b4f3-fd75984d9e33 req-31a1db55-d69c-4664-a530-89b7330cb29c service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:02:51.286442 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-e9943941-be52-4085-b4f3-fd75984d9e33 req-31a1db55-d69c-4664-a530-89b7330cb29c service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:02:51.286885 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-e9943941-be52-4085-b4f3-fd75984d9e33 req-31a1db55-d69c-4664-a530-89b7330cb29c service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:02:51.298794 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-e9943941-be52-4085-b4f3-fd75984d9e33 req-31a1db55-d69c-4664-a530-89b7330cb29c service nova] Creating event network-changed:0426987e-8896-40d4-862e-044635ac1fa0 for instance 0de50a90-4ba6-4c56-b0d0-5ba8b17479bd on hv-cinder-79966 Sep 03 04:02:51.304359 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-e9943941-be52-4085-b4f3-fd75984d9e33 req-31a1db55-d69c-4664-a530-89b7330cb29c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096968 Sep 03 04:02:51.304973 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 543/1102] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 04:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 04:04:19.256144 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-c446edc4-e260-4f56-9044-51ce9c9b9d6b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:04:19.256703 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-c446edc4-e260-4f56-9044-51ce9c9b9d6b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: 0de50a90-4ba6-4c56-b0d0-5ba8b17479bd] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:04:19.259114 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_api:SELECT=20 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:04:19.259899 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG dbcounter [-] [132076] Writing DB stats nova_cell1:SELECT=40 {{(pid=132076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:04:19.262353 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:04:19.263233 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG dbcounter [-] [132077] Writing DB stats nova_cell1:SELECT=46 {{(pid=132077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:04:19.264979 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-aae91667-76d8-4801-a0e0-ccd74c4a448b req-4fc22ef4-d450-433e-b1ae-012b4bc456a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0de50a90-4ba6-4c56-b0d0-5ba8b17479bd", "tag": "0426987e-8896-40d4-862e-044635ac1fa0"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 04:04:19.266709 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c446edc4-e260-4f56-9044-51ce9c9b9d6b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:04:19.267373 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c446edc4-e260-4f56-9044-51ce9c9b9d6b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:04:19.267683 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c446edc4-e260-4f56-9044-51ce9c9b9d6b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:04:19.268602 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c446edc4-e260-4f56-9044-51ce9c9b9d6b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:04:19.269031 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c446edc4-e260-4f56-9044-51ce9c9b9d6b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:04:19.269459 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-c446edc4-e260-4f56-9044-51ce9c9b9d6b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:04:19.279127 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-aae91667-76d8-4801-a0e0-ccd74c4a448b req-4fc22ef4-d450-433e-b1ae-012b4bc456a5 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:04:19.279784 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-aae91667-76d8-4801-a0e0-ccd74c4a448b req-4fc22ef4-d450-433e-b1ae-012b4bc456a5 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:04:19.280467 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-aae91667-76d8-4801-a0e0-ccd74c4a448b req-4fc22ef4-d450-433e-b1ae-012b4bc456a5 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:04:19.293662 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-aae91667-76d8-4801-a0e0-ccd74c4a448b req-4fc22ef4-d450-433e-b1ae-012b4bc456a5 service nova] Creating event network-changed:0426987e-8896-40d4-862e-044635ac1fa0 for instance 0de50a90-4ba6-4c56-b0d0-5ba8b17479bd on hv-cinder-79966 Sep 03 04:04:19.298994 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-aae91667-76d8-4801-a0e0-ccd74c4a448b req-4fc22ef4-d450-433e-b1ae-012b4bc456a5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041779 Sep 03 04:04:19.299607 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 544/1103] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 04:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 04:04:19.303692 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-c446edc4-e260-4f56-9044-51ce9c9b9d6b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: 0de50a90-4ba6-4c56-b0d0-5ba8b17479bd] Going to try to terminate instance {{(pid=132077) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 04:04:19.393966 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-c446edc4-e260-4f56-9044-51ce9c9b9d6b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd" status: 204 len: 0 microversion: 2.1 time: 0.142623 Sep 03 04:04:19.394962 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 560/1104] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Sep 3 04:04:19 2022] DELETE /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 04:04:19.409388 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-7aa1b52c-e774-476c-b7b7-c2fc6652d632 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:04:19.410038 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-7aa1b52c-e774-476c-b7b7-c2fc6652d632 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: 0de50a90-4ba6-4c56-b0d0-5ba8b17479bd] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:04:19.416384 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7aa1b52c-e774-476c-b7b7-c2fc6652d632 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:04:19.416865 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7aa1b52c-e774-476c-b7b7-c2fc6652d632 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:04:19.417295 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7aa1b52c-e774-476c-b7b7-c2fc6652d632 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:04:19.417993 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7aa1b52c-e774-476c-b7b7-c2fc6652d632 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:04:19.418439 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7aa1b52c-e774-476c-b7b7-c2fc6652d632 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:04:19.418886 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-7aa1b52c-e774-476c-b7b7-c2fc6652d632 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:04:19.612920 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-7aa1b52c-e774-476c-b7b7-c2fc6652d632 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:04:19.621426 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-7aa1b52c-e774-476c-b7b7-c2fc6652d632 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd" status: 200 len: 1575 microversion: 2.1 time: 0.220577 Sep 03 04:04:19.621915 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 545/1105] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:04:19 2022] GET /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd => generated 1575 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:04:20.645475 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-3f5e4d81-78ba-4c65-9827-1a576baf9955 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:04:20.646138 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-3f5e4d81-78ba-4c65-9827-1a576baf9955 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: 0de50a90-4ba6-4c56-b0d0-5ba8b17479bd] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:04:20.653122 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3f5e4d81-78ba-4c65-9827-1a576baf9955 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:04:20.653617 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3f5e4d81-78ba-4c65-9827-1a576baf9955 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:04:20.654044 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3f5e4d81-78ba-4c65-9827-1a576baf9955 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:04:20.654783 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3f5e4d81-78ba-4c65-9827-1a576baf9955 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:04:20.655245 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3f5e4d81-78ba-4c65-9827-1a576baf9955 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:04:20.655691 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-3f5e4d81-78ba-4c65-9827-1a576baf9955 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:04:20.841549 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-3f5e4d81-78ba-4c65-9827-1a576baf9955 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:04:20.849633 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-3f5e4d81-78ba-4c65-9827-1a576baf9955 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd" status: 200 len: 1575 microversion: 2.1 time: 0.208525 Sep 03 04:04:20.850217 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 561/1106] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:04:20 2022] GET /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd => generated 1575 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:04:21.426204 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-5c324b19-a289-462e-a741-527a83de0dc5 req-9852bcaf-4998-4f90-8424-065929e20ffa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0de50a90-4ba6-4c56-b0d0-5ba8b17479bd", "name": "network-vif-deleted", "tag": "0426987e-8896-40d4-862e-044635ac1fa0"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 04:04:21.437532 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-5c324b19-a289-462e-a741-527a83de0dc5 req-9852bcaf-4998-4f90-8424-065929e20ffa service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:04:21.437999 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-5c324b19-a289-462e-a741-527a83de0dc5 req-9852bcaf-4998-4f90-8424-065929e20ffa service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:04:21.438623 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-5c324b19-a289-462e-a741-527a83de0dc5 req-9852bcaf-4998-4f90-8424-065929e20ffa service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:04:21.453878 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-5c324b19-a289-462e-a741-527a83de0dc5 req-9852bcaf-4998-4f90-8424-065929e20ffa service nova] Creating event network-vif-deleted:0426987e-8896-40d4-862e-044635ac1fa0 for instance 0de50a90-4ba6-4c56-b0d0-5ba8b17479bd on hv-cinder-79966 Sep 03 04:04:21.458827 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-5c324b19-a289-462e-a741-527a83de0dc5 req-9852bcaf-4998-4f90-8424-065929e20ffa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038737 Sep 03 04:04:21.459481 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 546/1107] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 04:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 04:04:21.875004 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-728286c9-6d7e-4266-9c55-959216d904c0 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:04:21.875637 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-728286c9-6d7e-4266-9c55-959216d904c0 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: 0de50a90-4ba6-4c56-b0d0-5ba8b17479bd] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:04:21.882385 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-728286c9-6d7e-4266-9c55-959216d904c0 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:04:21.882902 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-728286c9-6d7e-4266-9c55-959216d904c0 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:04:21.883325 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-728286c9-6d7e-4266-9c55-959216d904c0 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:04:21.884146 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-728286c9-6d7e-4266-9c55-959216d904c0 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:04:21.884610 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-728286c9-6d7e-4266-9c55-959216d904c0 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:04:21.885515 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-728286c9-6d7e-4266-9c55-959216d904c0 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:04:21.923321 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-728286c9-6d7e-4266-9c55-959216d904c0 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:04:21.923804 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-728286c9-6d7e-4266-9c55-959216d904c0 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:04:21.924241 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-728286c9-6d7e-4266-9c55-959216d904c0 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:04:21.924687 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.objects.instance [None req-728286c9-6d7e-4266-9c55-959216d904c0 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lazy-loading 'fault' on Instance uuid 0de50a90-4ba6-4c56-b0d0-5ba8b17479bd {{(pid=132077) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 04:04:21.977643 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-728286c9-6d7e-4266-9c55-959216d904c0 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:04:21.985975 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-728286c9-6d7e-4266-9c55-959216d904c0 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd" status: 200 len: 1229 microversion: 2.1 time: 0.114865 Sep 03 04:04:21.986538 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 562/1108] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:04:21 2022] GET /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd => generated 1229 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:04:23.014829 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-d3abc5a0-f6ea-4fe6-bffb-30431640671b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:04:23.015411 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-d3abc5a0-f6ea-4fe6-bffb-30431640671b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: 0de50a90-4ba6-4c56-b0d0-5ba8b17479bd] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:04:23.022310 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d3abc5a0-f6ea-4fe6-bffb-30431640671b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:04:23.022779 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d3abc5a0-f6ea-4fe6-bffb-30431640671b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:04:23.023237 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d3abc5a0-f6ea-4fe6-bffb-30431640671b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:04:23.023915 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d3abc5a0-f6ea-4fe6-bffb-30431640671b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:04:23.024359 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d3abc5a0-f6ea-4fe6-bffb-30431640671b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:04:23.024771 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-d3abc5a0-f6ea-4fe6-bffb-30431640671b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:04:23.038065 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.wsgi [None req-d3abc5a0-f6ea-4fe6-bffb-30431640671b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] HTTP exception thrown: Instance 0de50a90-4ba6-4c56-b0d0-5ba8b17479bd could not be found. Sep 03 04:04:23.039822 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-d3abc5a0-f6ea-4fe6-bffb-30431640671b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Request method failure captured: Sep 03 04:04:23.039822 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: request: GET /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd HTTP/1.1 Sep 03 04:04:23.039822 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept: application/json Sep 03 04:04:23.039822 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept-Encoding: identity Sep 03 04:04:23.039822 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Connection: close Sep 03 04:04:23.039822 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Length: 0 Sep 03 04:04:23.039822 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Type: application/json Sep 03 04:04:23.039822 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Host: 10.222.0.25 Sep 03 04:04:23.039822 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Openstack-System-Scope: None Sep 03 04:04:23.039822 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: User-Agent: python-urllib3/1.26.12 Sep 03 04:04:23.039822 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Auth-Token: gAAAAABjEtC_1ebsxjRVOwgkneWIx8Dwu2Q0W3ZocvBaFG6KWTBaNy6BfBf-DVcl7qmUnoeteuk-ITfA_OXnutEW1694UqHOBAYx-0arZ7KlehUSjxhVIzPfx8U3fuxOCmayhzYvtntGKmn6phRXtpRbVPO1tQ54x1TheOsy16Wq_aJuJ1ErBx4 Sep 03 04:04:23.039822 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Id: None Sep 03 04:04:23.039822 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Name: None Sep 03 04:04:23.039822 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Identity-Status: Confirmed Sep 03 04:04:23.039822 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Is-Admin-Project: True Sep 03 04:04:23.039822 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Id: default Sep 03 04:04:23.039822 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Name: Default Sep 03 04:04:23.039822 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Id: f40913ed988e4d3f8164fad43a6e8508 Sep 03 04:04:23.039822 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Name: tempest-TestVolumeBootPattern-130000365 Sep 03 04:04:23.039822 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Role: member,reader Sep 03 04:04:23.039822 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Roles: member,reader Sep 03 04:04:23.041661 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f40913ed988e4d3f8164fad43a6e8508"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f40913ed988e4d3f8164fad43a6e8508"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f40913ed988e4d3f8164fad43a6e8508"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f40913ed988e4d3f8164fad43a6e8508"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 04:04:23.041661 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant: tempest-TestVolumeBootPattern-130000365 Sep 03 04:04:23.041661 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Id: f40913ed988e4d3f8164fad43a6e8508 Sep 03 04:04:23.041661 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Name: tempest-TestVolumeBootPattern-130000365 Sep 03 04:04:23.041661 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User: tempest-TestVolumeBootPattern-130000365-project Sep 03 04:04:23.041661 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Id: default Sep 03 04:04:23.041661 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Name: Default Sep 03 04:04:23.041661 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Id: 1b4df8619fbc4d3bb4097fde33a400f7 Sep 03 04:04:23.041661 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Name: tempest-TestVolumeBootPattern-130000365-project Sep 03 04:04:23.041661 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: method: > Sep 03 04:04:23.041661 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: exception: Instance 0de50a90-4ba6-4c56-b0d0-5ba8b17479bd could not be found. Sep 03 04:04:23.041661 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: action_args: {'id': '0de50a90-4ba6-4c56-b0d0-5ba8b17479bd'} Sep 03 04:04:23.042680 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 04:04:23.042680 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 04:04:23.042680 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 04:04:23.042680 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 04:04:23.042680 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 04:04:23.042680 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 04:04:23.042680 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 04:04:23.042680 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 04:04:23.042680 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 04:04:23.042680 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 04:04:23.042680 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0de50a90-4ba6-4c56-b0d0-5ba8b17479bd could not be found. Sep 03 04:04:23.042680 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 04:04:23.042680 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 04:04:23.042680 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 04:04:23.042680 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 04:04:23.042680 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 04:04:23.042680 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 04:04:23.042680 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 04:04:23.042680 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 04:04:23.042680 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 04:04:23.044555 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 04:04:23.044555 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 04:04:23.044555 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 04:04:23.044555 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 04:04:23.044555 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 04:04:23.044555 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 04:04:23.044555 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 04:04:23.044555 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0de50a90-4ba6-4c56-b0d0-5ba8b17479bd could not be found. Sep 03 04:04:23.044555 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 04:04:23.044555 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 04:04:23.044555 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 04:04:23.044555 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 04:04:23.044555 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 04:04:23.044555 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 04:04:23.044555 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 04:04:23.044555 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 04:04:23.044555 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0de50a90-4ba6-4c56-b0d0-5ba8b17479bd could not be found. Sep 03 04:04:23.044555 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 04:04:23.046095 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-d3abc5a0-f6ea-4fe6-bffb-30431640671b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Returning 404 to user: Instance 0de50a90-4ba6-4c56-b0d0-5ba8b17479bd could not be found. {{(pid=132076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 04:04:23.046095 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-d3abc5a0-f6ea-4fe6-bffb-30431640671b tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd" status: 404 len: 111 microversion: 2.1 time: 0.032514 Sep 03 04:04:23.046095 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 547/1109] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:04:23 2022] GET /compute/v2.1/servers/0de50a90-4ba6-4c56-b0d0-5ba8b17479bd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 04:04:26.414297 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-75466519-48b3-4874-a633-641230276b7e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:04:26.414861 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-75466519-48b3-4874-a633-641230276b7e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: d58279b4-98e4-4856-899b-fa2c9c397244] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:04:26.415509 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-244c7649-ba83-45e7-b196-d2ffb947c461 req-8cbd7848-f437-437e-b58b-aed41e2fef99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d58279b4-98e4-4856-899b-fa2c9c397244", "tag": "e4e92cf0-9e6c-40a6-a76b-320356acf58e"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 04:04:26.428841 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-244c7649-ba83-45e7-b196-d2ffb947c461 req-8cbd7848-f437-437e-b58b-aed41e2fef99 service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:04:26.429082 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-75466519-48b3-4874-a633-641230276b7e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:04:26.429287 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-244c7649-ba83-45e7-b196-d2ffb947c461 req-8cbd7848-f437-437e-b58b-aed41e2fef99 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:04:26.429501 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-75466519-48b3-4874-a633-641230276b7e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:04:26.430152 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-244c7649-ba83-45e7-b196-d2ffb947c461 req-8cbd7848-f437-437e-b58b-aed41e2fef99 service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:04:26.430313 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-75466519-48b3-4874-a633-641230276b7e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:04:26.430859 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-75466519-48b3-4874-a633-641230276b7e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:04:26.431322 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-75466519-48b3-4874-a633-641230276b7e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:04:26.431744 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-75466519-48b3-4874-a633-641230276b7e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:04:26.441624 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-244c7649-ba83-45e7-b196-d2ffb947c461 req-8cbd7848-f437-437e-b58b-aed41e2fef99 service nova] Creating event network-changed:e4e92cf0-9e6c-40a6-a76b-320356acf58e for instance d58279b4-98e4-4856-899b-fa2c9c397244 on hv-cinder-79966 Sep 03 04:04:26.446994 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-244c7649-ba83-45e7-b196-d2ffb947c461 req-8cbd7848-f437-437e-b58b-aed41e2fef99 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038985 Sep 03 04:04:26.448024 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 548/1110] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 04:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 04:04:26.460177 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-75466519-48b3-4874-a633-641230276b7e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: d58279b4-98e4-4856-899b-fa2c9c397244] Going to try to terminate instance {{(pid=132077) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 04:04:26.544396 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-75466519-48b3-4874-a633-641230276b7e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244" status: 204 len: 0 microversion: 2.1 time: 0.137957 Sep 03 04:04:26.545449 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 563/1111] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Sep 3 04:04:26 2022] DELETE /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 04:04:26.558775 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-5f32b572-a5b7-4e96-8de0-4f714f3fad2e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:04:26.559667 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-5f32b572-a5b7-4e96-8de0-4f714f3fad2e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: d58279b4-98e4-4856-899b-fa2c9c397244] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:04:26.566283 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5f32b572-a5b7-4e96-8de0-4f714f3fad2e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:04:26.566838 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5f32b572-a5b7-4e96-8de0-4f714f3fad2e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:04:26.567260 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5f32b572-a5b7-4e96-8de0-4f714f3fad2e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:04:26.567984 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5f32b572-a5b7-4e96-8de0-4f714f3fad2e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:04:26.568420 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5f32b572-a5b7-4e96-8de0-4f714f3fad2e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:04:26.568811 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-5f32b572-a5b7-4e96-8de0-4f714f3fad2e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:04:26.705362 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.policy [None req-5f32b572-a5b7-4e96-8de0-4f714f3fad2e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132076) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:04:26.713603 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-5f32b572-a5b7-4e96-8de0-4f714f3fad2e tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244" status: 200 len: 1576 microversion: 2.1 time: 0.163253 Sep 03 04:04:26.714145 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 549/1112] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:04:26 2022] GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:04:27.740680 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-16a62161-4b64-4b53-854d-b2f868598fee tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:04:27.741650 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-16a62161-4b64-4b53-854d-b2f868598fee tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: d58279b4-98e4-4856-899b-fa2c9c397244] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:04:27.748757 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-16a62161-4b64-4b53-854d-b2f868598fee tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:04:27.749251 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-16a62161-4b64-4b53-854d-b2f868598fee tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:04:27.749682 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-16a62161-4b64-4b53-854d-b2f868598fee tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:04:27.750396 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-16a62161-4b64-4b53-854d-b2f868598fee tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:04:27.750841 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-16a62161-4b64-4b53-854d-b2f868598fee tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:04:27.751292 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-16a62161-4b64-4b53-854d-b2f868598fee tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:04:27.949816 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-16a62161-4b64-4b53-854d-b2f868598fee tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:04:27.958140 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-16a62161-4b64-4b53-854d-b2f868598fee tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244" status: 200 len: 1576 microversion: 2.1 time: 0.223739 Sep 03 04:04:27.958679 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 564/1113] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:04:27 2022] GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244 => generated 1576 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:04:28.797644 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [req-1cf3cfb8-64cc-42ed-8503-f186b475d32e req-7fdb9de8-7688-4947-89cb-3867b79980ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d58279b4-98e4-4856-899b-fa2c9c397244", "name": "network-vif-deleted", "tag": "e4e92cf0-9e6c-40a6-a76b-320356acf58e"}]} {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 04:04:28.808285 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-1cf3cfb8-64cc-42ed-8503-f186b475d32e req-7fdb9de8-7688-4947-89cb-3867b79980ab service nova] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:04:28.808750 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-1cf3cfb8-64cc-42ed-8503-f186b475d32e req-7fdb9de8-7688-4947-89cb-3867b79980ab service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:04:28.809184 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [req-1cf3cfb8-64cc-42ed-8503-f186b475d32e req-7fdb9de8-7688-4947-89cb-3867b79980ab service nova] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:04:28.826185 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.compute.server_external_events [req-1cf3cfb8-64cc-42ed-8503-f186b475d32e req-7fdb9de8-7688-4947-89cb-3867b79980ab service nova] Creating event network-vif-deleted:e4e92cf0-9e6c-40a6-a76b-320356acf58e for instance d58279b4-98e4-4856-899b-fa2c9c397244 on hv-cinder-79966 Sep 03 04:04:28.831397 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [req-1cf3cfb8-64cc-42ed-8503-f186b475d32e req-7fdb9de8-7688-4947-89cb-3867b79980ab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037372 Sep 03 04:04:28.832004 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 550/1114] 10.222.0.25 () {64 vars in 1317 bytes} [Sat Sep 3 04:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 04:04:28.982129 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-129cbeb3-c674-4c99-8e08-952e29fbf564 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:04:28.982690 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-129cbeb3-c674-4c99-8e08-952e29fbf564 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: d58279b4-98e4-4856-899b-fa2c9c397244] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:04:28.989369 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-129cbeb3-c674-4c99-8e08-952e29fbf564 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:04:28.989855 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-129cbeb3-c674-4c99-8e08-952e29fbf564 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:04:28.990693 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-129cbeb3-c674-4c99-8e08-952e29fbf564 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:04:28.991501 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-129cbeb3-c674-4c99-8e08-952e29fbf564 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:04:28.992135 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-129cbeb3-c674-4c99-8e08-952e29fbf564 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:04:28.993489 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-129cbeb3-c674-4c99-8e08-952e29fbf564 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:04:29.055899 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.policy [None req-129cbeb3-c674-4c99-8e08-952e29fbf564 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4df8619fbc4d3bb4097fde33a400f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40913ed988e4d3f8164fad43a6e8508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132077) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 04:04:29.063980 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-129cbeb3-c674-4c99-8e08-952e29fbf564 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244" status: 200 len: 1224 microversion: 2.1 time: 0.085807 Sep 03 04:04:29.064523 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 565/1115] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:04:28 2022] GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 04:04:30.091920 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-83570e17-98e6-40eb-a192-f86a906a5132 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:04:30.093063 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-83570e17-98e6-40eb-a192-f86a906a5132 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: d58279b4-98e4-4856-899b-fa2c9c397244] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:04:30.105073 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-83570e17-98e6-40eb-a192-f86a906a5132 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:04:30.105906 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-83570e17-98e6-40eb-a192-f86a906a5132 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:04:30.106617 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-83570e17-98e6-40eb-a192-f86a906a5132 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:04:30.107796 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-83570e17-98e6-40eb-a192-f86a906a5132 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:04:30.108511 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-83570e17-98e6-40eb-a192-f86a906a5132 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:04:30.109240 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-83570e17-98e6-40eb-a192-f86a906a5132 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:04:30.126360 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.wsgi [None req-83570e17-98e6-40eb-a192-f86a906a5132 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] HTTP exception thrown: Instance d58279b4-98e4-4856-899b-fa2c9c397244 could not be found. Sep 03 04:04:30.127996 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-83570e17-98e6-40eb-a192-f86a906a5132 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Request method failure captured: Sep 03 04:04:30.127996 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: request: GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244 HTTP/1.1 Sep 03 04:04:30.127996 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept: application/json Sep 03 04:04:30.127996 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept-Encoding: identity Sep 03 04:04:30.127996 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Connection: close Sep 03 04:04:30.127996 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Length: 0 Sep 03 04:04:30.127996 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Type: application/json Sep 03 04:04:30.127996 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Host: 10.222.0.25 Sep 03 04:04:30.127996 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Openstack-System-Scope: None Sep 03 04:04:30.127996 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: User-Agent: python-urllib3/1.26.12 Sep 03 04:04:30.127996 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Auth-Token: gAAAAABjEtC_1ebsxjRVOwgkneWIx8Dwu2Q0W3ZocvBaFG6KWTBaNy6BfBf-DVcl7qmUnoeteuk-ITfA_OXnutEW1694UqHOBAYx-0arZ7KlehUSjxhVIzPfx8U3fuxOCmayhzYvtntGKmn6phRXtpRbVPO1tQ54x1TheOsy16Wq_aJuJ1ErBx4 Sep 03 04:04:30.127996 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Id: None Sep 03 04:04:30.127996 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Name: None Sep 03 04:04:30.127996 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Identity-Status: Confirmed Sep 03 04:04:30.127996 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Is-Admin-Project: True Sep 03 04:04:30.127996 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Id: default Sep 03 04:04:30.127996 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Name: Default Sep 03 04:04:30.127996 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Id: f40913ed988e4d3f8164fad43a6e8508 Sep 03 04:04:30.127996 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Name: tempest-TestVolumeBootPattern-130000365 Sep 03 04:04:30.127996 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Role: member,reader Sep 03 04:04:30.127996 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Roles: member,reader Sep 03 04:04:30.129871 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f40913ed988e4d3f8164fad43a6e8508"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f40913ed988e4d3f8164fad43a6e8508"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f40913ed988e4d3f8164fad43a6e8508"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f40913ed988e4d3f8164fad43a6e8508"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 04:04:30.129871 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant: tempest-TestVolumeBootPattern-130000365 Sep 03 04:04:30.129871 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Id: f40913ed988e4d3f8164fad43a6e8508 Sep 03 04:04:30.129871 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Name: tempest-TestVolumeBootPattern-130000365 Sep 03 04:04:30.129871 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User: tempest-TestVolumeBootPattern-130000365-project Sep 03 04:04:30.129871 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Id: default Sep 03 04:04:30.129871 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Name: Default Sep 03 04:04:30.129871 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Id: 1b4df8619fbc4d3bb4097fde33a400f7 Sep 03 04:04:30.129871 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Name: tempest-TestVolumeBootPattern-130000365-project Sep 03 04:04:30.129871 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: method: > Sep 03 04:04:30.129871 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: exception: Instance d58279b4-98e4-4856-899b-fa2c9c397244 could not be found. Sep 03 04:04:30.129871 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: action_args: {'id': 'd58279b4-98e4-4856-899b-fa2c9c397244'} Sep 03 04:04:30.130901 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 04:04:30.130901 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 04:04:30.130901 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 04:04:30.130901 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 04:04:30.130901 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 04:04:30.130901 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 04:04:30.130901 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 04:04:30.130901 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 04:04:30.130901 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 04:04:30.130901 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 04:04:30.130901 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d58279b4-98e4-4856-899b-fa2c9c397244 could not be found. Sep 03 04:04:30.130901 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 04:04:30.130901 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 04:04:30.130901 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 04:04:30.130901 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 04:04:30.130901 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 04:04:30.130901 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 04:04:30.130901 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 04:04:30.130901 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 04:04:30.130901 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 04:04:30.132625 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 04:04:30.132625 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 04:04:30.132625 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 04:04:30.132625 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 04:04:30.132625 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 04:04:30.132625 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 04:04:30.132625 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 04:04:30.132625 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d58279b4-98e4-4856-899b-fa2c9c397244 could not be found. Sep 03 04:04:30.132625 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 04:04:30.132625 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 04:04:30.132625 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 04:04:30.132625 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 04:04:30.132625 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 04:04:30.132625 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 04:04:30.132625 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 04:04:30.132625 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 04:04:30.132625 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d58279b4-98e4-4856-899b-fa2c9c397244 could not be found. Sep 03 04:04:30.132625 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 04:04:30.134164 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-83570e17-98e6-40eb-a192-f86a906a5132 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Returning 404 to user: Instance d58279b4-98e4-4856-899b-fa2c9c397244 could not be found. {{(pid=132076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 04:04:30.134164 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-83570e17-98e6-40eb-a192-f86a906a5132 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244" status: 404 len: 111 microversion: 2.1 time: 0.044721 Sep 03 04:04:30.134164 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 551/1116] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:04:30 2022] GET /compute/v2.1/servers/d58279b4-98e4-4856-899b-fa2c9c397244 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 04:04:30.592172 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-d1229e50-5383-4b26-969b-64111ab826b1 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:04:30.592737 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.compute.api [None req-d1229e50-5383-4b26-969b-64111ab826b1 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: b6ffe18c-8f84-4388-a17a-60885c5f9f1c] Fetching instance by UUID {{(pid=132077) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:04:30.599042 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d1229e50-5383-4b26-969b-64111ab826b1 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:04:30.599514 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d1229e50-5383-4b26-969b-64111ab826b1 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:04:30.599948 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d1229e50-5383-4b26-969b-64111ab826b1 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:04:30.600623 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d1229e50-5383-4b26-969b-64111ab826b1 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:04:30.601048 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d1229e50-5383-4b26-969b-64111ab826b1 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:04:30.601829 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG oslo_concurrency.lockutils [None req-d1229e50-5383-4b26-969b-64111ab826b1 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:04:30.615255 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.wsgi [None req-d1229e50-5383-4b26-969b-64111ab826b1 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] HTTP exception thrown: Instance b6ffe18c-8f84-4388-a17a-60885c5f9f1c could not be found. Sep 03 04:04:30.616902 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-d1229e50-5383-4b26-969b-64111ab826b1 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Request method failure captured: Sep 03 04:04:30.616902 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: request: DELETE /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c HTTP/1.1 Sep 03 04:04:30.616902 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept: application/json Sep 03 04:04:30.616902 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Accept-Encoding: identity Sep 03 04:04:30.616902 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Connection: close Sep 03 04:04:30.616902 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Length: 0 Sep 03 04:04:30.616902 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Content-Type: application/json Sep 03 04:04:30.616902 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Host: 10.222.0.25 Sep 03 04:04:30.616902 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: Openstack-System-Scope: None Sep 03 04:04:30.616902 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: User-Agent: python-urllib3/1.26.12 Sep 03 04:04:30.616902 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Auth-Token: gAAAAABjEtC_1ebsxjRVOwgkneWIx8Dwu2Q0W3ZocvBaFG6KWTBaNy6BfBf-DVcl7qmUnoeteuk-ITfA_OXnutEW1694UqHOBAYx-0arZ7KlehUSjxhVIzPfx8U3fuxOCmayhzYvtntGKmn6phRXtpRbVPO1tQ54x1TheOsy16Wq_aJuJ1ErBx4 Sep 03 04:04:30.616902 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Id: None Sep 03 04:04:30.616902 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Domain-Name: None Sep 03 04:04:30.616902 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Identity-Status: Confirmed Sep 03 04:04:30.616902 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Is-Admin-Project: True Sep 03 04:04:30.616902 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Id: default Sep 03 04:04:30.616902 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Domain-Name: Default Sep 03 04:04:30.616902 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Id: f40913ed988e4d3f8164fad43a6e8508 Sep 03 04:04:30.616902 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Project-Name: tempest-TestVolumeBootPattern-130000365 Sep 03 04:04:30.616902 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Role: member,reader Sep 03 04:04:30.616902 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Roles: member,reader Sep 03 04:04:30.618584 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f40913ed988e4d3f8164fad43a6e8508"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f40913ed988e4d3f8164fad43a6e8508"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f40913ed988e4d3f8164fad43a6e8508"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f40913ed988e4d3f8164fad43a6e8508"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 04:04:30.618584 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant: tempest-TestVolumeBootPattern-130000365 Sep 03 04:04:30.618584 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Id: f40913ed988e4d3f8164fad43a6e8508 Sep 03 04:04:30.618584 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-Tenant-Name: tempest-TestVolumeBootPattern-130000365 Sep 03 04:04:30.618584 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User: tempest-TestVolumeBootPattern-130000365-project Sep 03 04:04:30.618584 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Id: default Sep 03 04:04:30.618584 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Domain-Name: Default Sep 03 04:04:30.618584 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Id: 1b4df8619fbc4d3bb4097fde33a400f7 Sep 03 04:04:30.618584 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: X-User-Name: tempest-TestVolumeBootPattern-130000365-project Sep 03 04:04:30.618584 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: method: > Sep 03 04:04:30.618584 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: exception: Instance b6ffe18c-8f84-4388-a17a-60885c5f9f1c could not be found. Sep 03 04:04:30.618584 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: action_args: {'id': 'b6ffe18c-8f84-4388-a17a-60885c5f9f1c'} Sep 03 04:04:30.622850 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 04:04:30.622850 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 04:04:30.622850 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 04:04:30.622850 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 04:04:30.622850 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 04:04:30.622850 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 04:04:30.622850 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 04:04:30.622850 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 04:04:30.622850 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 04:04:30.622850 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 04:04:30.622850 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6ffe18c-8f84-4388-a17a-60885c5f9f1c could not be found. Sep 03 04:04:30.622850 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 04:04:30.622850 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 04:04:30.622850 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 04:04:30.622850 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 04:04:30.622850 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 04:04:30.622850 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 04:04:30.622850 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 04:04:30.622850 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 04:04:30.622850 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 04:04:30.624501 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 04:04:30.624501 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 04:04:30.624501 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 04:04:30.624501 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 04:04:30.624501 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 04:04:30.624501 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 04:04:30.624501 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 04:04:30.624501 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 04:04:30.624501 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 04:04:30.624501 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6ffe18c-8f84-4388-a17a-60885c5f9f1c could not be found. Sep 03 04:04:30.624501 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 04:04:30.624501 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 04:04:30.624501 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 04:04:30.624501 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 04:04:30.624501 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 04:04:30.624501 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 04:04:30.624501 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 04:04:30.624501 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 04:04:30.624501 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6ffe18c-8f84-4388-a17a-60885c5f9f1c could not be found. Sep 03 04:04:30.624501 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: ERROR nova.api.openstack.wsgi Sep 03 04:04:30.626144 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-d1229e50-5383-4b26-969b-64111ab826b1 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Returning 404 to user: Instance b6ffe18c-8f84-4388-a17a-60885c5f9f1c could not be found. {{(pid=132077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 04:04:30.626144 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-d1229e50-5383-4b26-969b-64111ab826b1 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c" status: 404 len: 111 microversion: 2.1 time: 0.030174 Sep 03 04:04:30.626144 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 566/1117] 10.222.0.25 () {58 vars in 1239 bytes} [Sat Sep 3 04:04:30 2022] DELETE /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 04:04:30.627049 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-0fdacce8-208b-4f66-b84c-af6b173f69e5 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '>' {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:04:30.627648 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.compute.api [None req-0fdacce8-208b-4f66-b84c-af6b173f69e5 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] [instance: b6ffe18c-8f84-4388-a17a-60885c5f9f1c] Fetching instance by UUID {{(pid=132076) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 04:04:30.633560 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0fdacce8-208b-4f66-b84c-af6b173f69e5 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:04:30.634164 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0fdacce8-208b-4f66-b84c-af6b173f69e5 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:04:30.634589 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0fdacce8-208b-4f66-b84c-af6b173f69e5 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:04:30.635297 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0fdacce8-208b-4f66-b84c-af6b173f69e5 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Acquiring lock "f0044725-3830-4c39-ba2b-0d5fbf875774" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 04:04:30.635735 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0fdacce8-208b-4f66-b84c-af6b173f69e5 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 04:04:30.636146 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG oslo_concurrency.lockutils [None req-0fdacce8-208b-4f66-b84c-af6b173f69e5 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Lock "f0044725-3830-4c39-ba2b-0d5fbf875774" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 04:04:30.649401 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.wsgi [None req-0fdacce8-208b-4f66-b84c-af6b173f69e5 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] HTTP exception thrown: Instance b6ffe18c-8f84-4388-a17a-60885c5f9f1c could not be found. Sep 03 04:04:30.650930 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-0fdacce8-208b-4f66-b84c-af6b173f69e5 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Request method failure captured: Sep 03 04:04:30.650930 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: request: GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c HTTP/1.1 Sep 03 04:04:30.650930 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept: application/json Sep 03 04:04:30.650930 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Accept-Encoding: identity Sep 03 04:04:30.650930 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Connection: close Sep 03 04:04:30.650930 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Length: 0 Sep 03 04:04:30.650930 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Content-Type: application/json Sep 03 04:04:30.650930 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Host: 10.222.0.25 Sep 03 04:04:30.650930 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: Openstack-System-Scope: None Sep 03 04:04:30.650930 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: User-Agent: python-urllib3/1.26.12 Sep 03 04:04:30.650930 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Auth-Token: gAAAAABjEtC_1ebsxjRVOwgkneWIx8Dwu2Q0W3ZocvBaFG6KWTBaNy6BfBf-DVcl7qmUnoeteuk-ITfA_OXnutEW1694UqHOBAYx-0arZ7KlehUSjxhVIzPfx8U3fuxOCmayhzYvtntGKmn6phRXtpRbVPO1tQ54x1TheOsy16Wq_aJuJ1ErBx4 Sep 03 04:04:30.650930 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Id: None Sep 03 04:04:30.650930 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Domain-Name: None Sep 03 04:04:30.650930 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Identity-Status: Confirmed Sep 03 04:04:30.650930 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Is-Admin-Project: True Sep 03 04:04:30.650930 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Id: default Sep 03 04:04:30.650930 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Domain-Name: Default Sep 03 04:04:30.650930 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Id: f40913ed988e4d3f8164fad43a6e8508 Sep 03 04:04:30.650930 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Project-Name: tempest-TestVolumeBootPattern-130000365 Sep 03 04:04:30.650930 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Role: member,reader Sep 03 04:04:30.650930 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Roles: member,reader Sep 03 04:04:30.652632 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f40913ed988e4d3f8164fad43a6e8508"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f40913ed988e4d3f8164fad43a6e8508"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f40913ed988e4d3f8164fad43a6e8508"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f40913ed988e4d3f8164fad43a6e8508"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 03 04:04:30.652632 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant: tempest-TestVolumeBootPattern-130000365 Sep 03 04:04:30.652632 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Id: f40913ed988e4d3f8164fad43a6e8508 Sep 03 04:04:30.652632 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-Tenant-Name: tempest-TestVolumeBootPattern-130000365 Sep 03 04:04:30.652632 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User: tempest-TestVolumeBootPattern-130000365-project Sep 03 04:04:30.652632 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Id: default Sep 03 04:04:30.652632 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Domain-Name: Default Sep 03 04:04:30.652632 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Id: 1b4df8619fbc4d3bb4097fde33a400f7 Sep 03 04:04:30.652632 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: X-User-Name: tempest-TestVolumeBootPattern-130000365-project Sep 03 04:04:30.652632 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: method: > Sep 03 04:04:30.652632 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: exception: Instance b6ffe18c-8f84-4388-a17a-60885c5f9f1c could not be found. Sep 03 04:04:30.652632 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: action_args: {'id': 'b6ffe18c-8f84-4388-a17a-60885c5f9f1c'} Sep 03 04:04:30.653566 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: {{(pid=132076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 04:04:30.653566 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 04:04:30.653566 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 04:04:30.653566 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 04:04:30.653566 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 04:04:30.653566 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 04:04:30.653566 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 04:04:30.653566 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 04:04:30.653566 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 04:04:30.653566 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 04:04:30.653566 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6ffe18c-8f84-4388-a17a-60885c5f9f1c could not be found. Sep 03 04:04:30.653566 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 04:04:30.653566 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 04:04:30.653566 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 04:04:30.653566 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 04:04:30.653566 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 04:04:30.653566 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 04:04:30.653566 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 04:04:30.653566 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 04:04:30.653566 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 04:04:30.655170 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 04:04:30.655170 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 04:04:30.655170 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 04:04:30.655170 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 04:04:30.655170 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 04:04:30.655170 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 04:04:30.655170 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 04:04:30.655170 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6ffe18c-8f84-4388-a17a-60885c5f9f1c could not be found. Sep 03 04:04:30.655170 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 04:04:30.655170 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 04:04:30.655170 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 04:04:30.655170 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 04:04:30.655170 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 04:04:30.655170 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 04:04:30.655170 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 04:04:30.655170 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 04:04:30.655170 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6ffe18c-8f84-4388-a17a-60885c5f9f1c could not be found. Sep 03 04:04:30.655170 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: ERROR nova.api.openstack.wsgi Sep 03 04:04:30.656679 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: DEBUG nova.api.openstack.wsgi [None req-0fdacce8-208b-4f66-b84c-af6b173f69e5 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Returning 404 to user: Instance b6ffe18c-8f84-4388-a17a-60885c5f9f1c could not be found. {{(pid=132076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 04:04:30.656679 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: INFO nova.api.openstack.requestlog [None req-0fdacce8-208b-4f66-b84c-af6b173f69e5 tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c" status: 404 len: 111 microversion: 2.1 time: 0.029115 Sep 03 04:04:30.656679 dv-cinder-799663-12-iscsi devstack@n-api.service[132076]: [pid: 132076|app: 0|req: 552/1118] 10.222.0.25 () {58 vars in 1236 bytes} [Sat Sep 3 04:04:30 2022] GET /compute/v2.1/servers/b6ffe18c-8f84-4388-a17a-60885c5f9f1c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 04:04:31.969606 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: DEBUG nova.api.openstack.wsgi [None req-fa2e5e19-41da-4a4e-ad76-2a4dc829ccfd tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] Calling method '.version_select at 0x7f45fc5a29d0>' {{(pid=132077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 04:04:31.994331 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: INFO nova.api.openstack.requestlog [None req-fa2e5e19-41da-4a4e-ad76-2a4dc829ccfd tempest-TestVolumeBootPattern-130000365 tempest-TestVolumeBootPattern-130000365-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-880761214" status: 202 len: 0 microversion: 2.1 time: 0.028478 Sep 03 04:04:31.999097 dv-cinder-799663-12-iscsi devstack@n-api.service[132077]: [pid: 132077|app: 0|req: 567/1119] 10.222.0.25 () {58 vars in 1260 bytes} [Sat Sep 3 04:04:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-880761214 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)